Lori Ballen is a member of the Amazon Associates Program and earns money from qualifying purchases. Posts contain affiliate links that benefit Lori as well.
In this short, 6-minute video tutorial, Lori Ballen, owner of a Las Vegas Real Estate Team shows you how to use Google’s Search Console to submit a URL (new content), and to Fetch, Render, and then request indexing on new or updated content.
Google Fetch and Render Video Tutorial
how does crawling work?
Creating new content is important for any great website. Updating content is equally important. In order to rank on the search engines, you must first be indexed by Google. This is the act of them sending Googlebot out to crawl your website, and then index pages that meet their quality guidelines.
Indexing is not the same thing as ranking. An indexed page, simply means that it is stored in Google’s database. Ranking is the position in which it shows up on the Search Engine Results Page (SERP) for a particular query (search).
Google doesn’t crawl all websites in their entirely or on the same schedule. Pages will be crawled or skipped based on their frequency of updates, traffic, page speed and other metrics Google uses to determine crawl frequency. The healthier your website is, the more crawls, indexing, and updating you will see.
How do i ask google to crawl my website?
- Log into your Google Search Console
- Locate the CRAWL option
- Click Fetch as Google
- Add your URL of the page you want crawled
- Click Fetch or Fetch and Render if you want to see how it appears.
- Or click this link and select the blue button.
- Once Google has fetched your page, select the request indexing button.
- Congratulations! You have submitted your page to Google.
In this video I’m going to show you how to fetch and render a crawl from Google to a new page … To an existing page on your website that you have updated. Now, in a previous video I did show you how to submit a URL. Google has a doesn’t crawl all websites with the same frequency. What happens is, Google bot comes out. It crawls your website and it crawls a certain amount of the pages and then it pulls in back for indexing. Depending on how often you’re updating your website, and the amount of traffic is going to make … Your page speed, is going to make a difference as to how much of your website Google actually crawls. You might make some changes to a website … To a webpage, and you might just be sitting there waiting to see those changes update, and they’re not updating frequently enough.
What you can actually do is use Google’s fetch and render to actually send it out to basically take a snapshot of what your new page looks like and then you can request indexing. Here, I’ve showed you in a previous video, if you actually go to Google and just hit submit URL, and you can also do this in your Google search console. Right here, this cute little cheat comes up here, and if you have a brand new page that you just posted, that you just created, you can paste that here and hit submit. You’re saying, “Hey Google, I’ve got a new page.” Now, this doesn’t guarantee any kind of indexing, or ranking, but it does say, “Hey Google, please come out and pick up this page.” Every time you create a new page, it’s a good idea to go ahead and submit this the URL.
Now we want to do fetch and crawl. We’re going to do Google, fetch and render, and then crawl, okay? What this is actually going to do, you can click here and read a little bit more about it, but we actually just want to go ahead and open it. You can also do this in your Google search console. Here, we’re going to select which one of our websites we want to pull a page from, okay? Now see here it opened a search console, so look at the left-hand side. If you were just to login to your search console, all you have to do is go down to crawl and then click fetch as Google. Now, we need to find a page on our website that we want Google to crawl. Let me go ahead and go over here to my website and let me just go ahead and grab a page that I want Google to crawl.
You take this URL up top, go back over to search console, and you don’t want … You don’t need that HTTPS in the front, or the top level domain. Just what comes after the slash there. Whoops, there we go. Okay, so now you can say, “Fetch and render on desktop or on mobile.” Let’s just do mobile and I’m going to do fetch and render. Now, Google goes out and it crawls the website and that allows you then to take a look at how it is indexing that page. Now, if you look down here. Here’s one we already did, because this one may take a minute. Here’s one I already did a little while ago and it tells me that page was redirected. I don’t want to actually index that page. I want to index the page that it was redirected to. Here we have another one, so request indexing.
Now, if I click on this little arrow here, then I’ve got details about the crawl and then I’ve got pictures of what it looks like. This is how Google bot saw the page and this is how a visitor to your website would’ve seen the page. This is perfect because they’re the same, okay? Now, let’s go ahead and go back to the one we just did. Okay, and now. Now, I have fetched it, I’ve rendered it, I say, “Yes, this is what it’s supposed to look like.” Now I can click this button and request indexing. It says, “You are submitting this following URL. Re-crawling happens a few minutes after you click go. At that time, the content of your page is what Google will index.” Now remember, it’s only going to index it if it meets the quality guidelines and it doesn’t have the no index checked off. Most of your website pages, as long as they’re set up correctly will index.
Remember, indexing just means Google puts it in the database. It does not mean you’re ranking in any particular position. This is just getting it into the database. Ranking happens after the analysis is done and it runs through its algorithms and determines where you should be placed in that position. Now you can also click here, crawl only to this URL, or crawl this URL and its direct links. I actually do like it to pull the extra links too, but as you can see here it says, “You have … ” I have nine submissions remaining of the 10 monthly quota, so I had to be careful about allowing it to crawl all the links on the page, because you can only do 10 of those in a month. I’m going to save that for my real meaty pages that have a lot of spinoff to them that I want to index all the links. In this case, I’m going to crawl only the URL and I’m going to click go. That’s all there is to it, so you can submit the URL for a new page, or you can fetch render and then crawl for a changed page.