Next, we wanted to find out precisely how fast the whole process is: from the moment you publish your new blog post until the moment you see your new backlinks on Semrush.
That's why we decided to take a look at the RSS feeds of large websites.
We used RSS feeds for two reasons:
The RSS feeds of large news publishers represent high-traffic sites
Country Email List that almost immediately gather backlinks when they generate new content
RSS feeds provide a publish date and time , which allowed us to track exactly how much time elapsed between when a new page was published and when a new backlink to that page appears in each tool.
First, we took approximately 20,000 URLs from the RSS feeds of various news outlets around the world.
Next, we measured how quickly Semrush discovered links to their new content compared to other data providers.
Then we measured the median time each tool took to scan the web and discover a new backlink.
To do this, we performed the following steps:
We have identified the RSS feeds of the most popular news channels on the web
For about a month we collected all the URLs from those feeds until we had collected 20,000 URLs
For each URL we calculated the difference between the time the URL was published according to the RSS feed and the time Semrush first saw it
DiscoveryTime =FirstSeenTime -PublishedTime
We then calculated the median of these ranges
We repeated the above process for Ahrefs, Moz, and Majestic
All URLs that were not seen by one of the SEO tools within 30 days of the publication date were discarded for each provider mentioned above
Surprisingly, the average time it took Semrush to show the new link after the landing page was created was just 19 minutes!