How to conduct a technical audit of a website through Screaming Frog?

The presence of technical errors on the site can negatively affect its ranking, which in turn will lead to a decrease in search traffic and positions in search engines. To identify technical errors, it is necessary to conduct a comprehensive technical SEO audit of the site. One of the main assistants in this complex and labor-intensive task for us is the Screaming Frog desktop program.





About Screaming Frog

Screaming Frog is a website crawling software whose key features are:





  • search for broken links;





  • search for links with redirects;





  • search for duplicate pages;





  • image analysis;





  • search for pages that are missing meta tags or main heading h1;





  • extracting elements from site pages;





  • search for blank pages or uninformative pages where there is very little content.





Using this program, you can analyze pages that are closed in the robots.txt file, check the presence and correct filling of alt tags in images, as well as the presence of the Canonical attribute, and much more. 





Screaming Frog can crawl the entire site, either a specific directory or a manually defined list of pages. In order not to create a heavy load on the server, you can stop scanning at any time. 





An important plus is that the scan result can be downloaded in csv or xlsx format. But there are also some downsides:





  • ;





  • , . ;





  • ( ).





.





« Screaming Frog», , , . .





, . «Response Code» — «Client Error (4xx)». .





?

«Inlinks». , . 





, . 





?

, «ctrl + shift + i», «ctrl + » .





. . . , , - . , .





– ?

, - . , , . , , , . .





301

301 – , , . , . 200 . , 301 . .





301 . «Response Code» — «Redirection (3xx)». 301 3xx .





301 ?

, . «Inlinks».  , , .





Outlinks, , .





?

. , , , , . , , . 





, , , . , title. , title, . : – , – . title -. 





title?

«Page Titles» — «Duplicate» -.





, title, -. 





, , 301 . , . 301 , , . 





. , (. ) .





h1

<h1>, . , . SEO- . , <h1> .





, h1?

«H1» — «Missing>. , h1. . 





«Multiple» , h1. , , <h2> — <h6> . 





«Duplicate» h1. , h1 . , / / , -.





Canonical

Canonical () . rel=canonical <link> , , URL- (, ). 





, , URL GET- ( , ..).





, , «Canonicals» — «All». «Missing» , . 





. . , .





«Crawl Dara» — «Internal» — «All». 





.





«Word Count», .





Keywords

Keywords . - , . 





, Keywords . 





, , «Meta Keywords» — «Missing», , . 





, . 





, «Crawl Data» — «Internal» — «Images». . «Status Code» — 200 . . , robots.txt , . 





«Size». 3 , . 





Noindex Nofollow

«noindex», «nofollow». , . , .





. «Directives» — «noindex» «nofollow» , . , .





. , , , - ..





, . , . , , Custom Extraction.





?





, , . 





Screaming Frog Configuration — Custom — Extraction.





, add, — CSSPath — Extract Inner HTML. CSS , .





.





, /services/, . , .





Custom Extraction , , . , .





, SEO- Screaming Frog. / , . 





, Screaming Frog, , . Google Search Console.





1-3 , .





It should be borne in mind that the elimination of technical deficiencies does not guarantee an improvement in rankings and an increase in search traffic. To increase the visibility of a site in search engines, it is necessary to comprehensively refine the technical component of the site, commercial factors, work with texts and meta tags, site structure, link environment and other factors. 





If you have any questions, we are ready to answer them in the comments.  





And if there are a lot of questions, we will reveal them in more detail in the next articles.








All Articles