Skip to content

Google Scraper helps you collect search results from Google.

License

Notifications You must be signed in to change notification settings

omkarcloud/google-scraper

Repository files navigation

👉 Explore Our Other Awesome Products

  • Geocoding API: Highly Accurate, Free and Unlimited Requests Geocoding API. Convert city names to latitude/longitude coordinates.

✨ Google Scraper 🚀

💦 Google Scraper helps you collect search results from Google. 💦

(Programming Language - Python 3)

google-scraper forks Repo stars google-scraper License issues

View

Open in Gitpod


Google Scraper helps you collect search results from Google.

🚀 Getting Started

1️⃣ Clone the Magic 🧙‍♀:

git clone https://github.com/omkarcloud/google-scraper
cd google-scraper

2️⃣ Install Dependencies 📦:

python -m pip install -r requirements.txt

3️⃣ Let the Scraping Begin 😎:

python main.py

Find your data in the output directory.

Google Scraper CSV Result

Note: If you don't have Python installed. Follow this Simple FAQ here and you will have your Google data in next 5 Minutes

🤔 FAQs

❓ How to Scrape Google?

  1. Open the main.py file.
  2. Update the queries list with the locations you are interested in. For example:
queries = [
  "Mango",
  "Watermelon",
]

Google.search(queries, max=10)
  1. Run it.
python main.py

Then find your data in the output directory.

❓ How to Scrape More Google Search Results Using Your Google API?

To scrape additional data, follow these steps to use our Google API. You can make 50 requests for free:

  1. Sign up on RapidAPI by visiting this link.

Sign Up on RapidAPI

  1. Then, subscribe to our Free Plan by visiting this link.

Subscribe to Free Plan

  1. Now, copy the API key.

Copy the API Key

  1. Use it in the scraper as follows:
Google.search("Orange", max=10, key="YOUR_API_KEY")
  1. Run the script, and you'll find your data in the output folder.
python main.py

The first 50 requests are free. After that, you can upgrade to the Pro Plan, which will get you 1000 requests for just $9.

❓ How did you build it?

We used Botasaurus, It's an All-in-One Web Scraping Framework with Anti-Detection, Parallelization, Asynchronous, and Caching Superpowers.

Botasaurus helped us cut down the development time by 50% and helped us focus only on the core extraction logic of the scraper.

If you are a Web Scraper, you should learn about Botasaurus here, because Botasaurus will save you countless hours in your life as a Web Scraper.

botasaurus

❓ Need More Help or Have Additional Questions?

For further help, contact us on WhatsApp. We'll be happy to help you out.

Contact Us on WhatsApp about Google Scraper

Love It? Star It! ⭐

Made with ❤️ using Botasaurus Web Scraping Framework

About

Google Scraper helps you collect search results from Google.

Topics

Resources

License

Security policy

Stars

Watchers

Forks

Releases

No releases published

Sponsor this project

Packages

No packages published

Contributors 3

  •  
  •  
  •