Nimble API: Generate Credentials and Start Web and Data Scraping

Nimble API: Generate Credentials and Start Web and Data Scraping

How to Generate Nimble API keys and perform your first Web Scraping

Are you ready to unlock the power of web data collection and automation? Nimble API is your all-in-one platform that simplifies the process of accessing, collecting, and delivering web data. Whether you're an SEO specialist, data analyst, AI developer, or sales professional, Nimble API empowers you to harness the vast ocean of web information. In this introductory guide, we'll explore what Nimble API has to offer and how to begin your journey into the world of web data.

What Can Nimble API Do for You?

Nimble API is your versatile companion for a range of web data collection needs. With just a URL and some basic parameters, Nimble API can create powerful web data pipelines for:

  • SERP Collection: Dive deep into search engine results pages (SERPs) for comprehensive SEO/SEM analysis.

  • E-Commerce Data: Access product data from the largest online marketplaces with ease, making price monitoring and product comparison a breeze.

  • AI Model Training: Gather training and parameter data to fuel your AI models and machine learning algorithms.

  • Sales Boost: Enrich your leads with valuable data, making your sales efforts more efficient and effective.

And this is just the beginning. Nimble API is designed to be flexible and adaptable to various use cases, making it a valuable tool for businesses and individuals alike.

How Nimble API Works

Nimble API encapsulates the entire data collection process into a unified package, simplifying the journey from URL to actionable data. Here's how it works:

  • Accessing Any URL: Nimble API can access any public URL on the web, giving you the freedom to explore the vast web landscape.

  • Collecting Web Data: It collects a wide range of web data, including text, images, and more, transforming the web into a valuable data source.

  • Parsing Data: Nimble API parses the collected data into usable JSON structures, making it easy to integrate into your workflows.

  • Multiple Storage Options: Choose from multiple storage options to store and manage your valuable data.

Available APIs

Nimble API offers a suite of powerful APIs to cater to your specific data collection needs. These include:

  • Web API: Your gateway to accessing web data from any public URL.

  • SERP API: Dive into search engine results for SEO/SEM analysis.

  • Places API: Access location-based data for geospatial analysis.

  • E-Commerce API: Gather product data from online marketplaces for competitive insights.

Getting Started

Getting started with Nimble API is a breeze, thanks to its user-friendly interface and detailed documentation.

Before you begin, ensure to have Python Installed on your machine. Have an account created on the Nimble platform and you can access this dashboard.

Here's a quick overview of the steps to begin your web data journey:

Authentication

Nimble API uses Basic access authentication for every request. To authenticate, generate a base64 encoded credential string using your Nimble credentials. For example:

import base64
auth = 'username@example.com:yourpassword'
encoded_bytes = base64.b64encode(auth.encode('utf-8'))
# Convert the bytes to a string
nimble_auth = encoded_bytes.decode('utf-8')

#Incase you want to see it!
print(nimble_auth)

Once you have your credential string, apply it to the header of every request.

Making Real-Time Requests

Real-time requests to the Web API are made using the https://api.webit.live/api/v1/realtime/web endpoint. You'll need to send the credential string with every request to authenticate your account.

import requests

url = 'https://api.webit.live/api/v1/realtime/web'
headers = {
    'Authorization': f'Basic {nimble_auth}',
    'Content-Type': 'application/json'
}
data = {
    # Add your parameters here
    "url": "https://www.octachart.com",
    "method": "GET",
    "parse": False,
    "render": True,
    "country": "CA",
    "locale": "en-GB",
    "headers": {
        "Some-Extra-Header": "Some-Extra-Header"
    }
}

response = requests.post(url, headers=headers, json=data)

print("NIMBLE STATUS ", response.status_code)

The only required parameter is the "URL," defining the address from which to collect data. Additional parameters, such as geolocation targeting and custom headers, can be added for more specific data collection needs.

Understanding the Response

If successful, the Web API will return 200 OK status with structured data, including the HTML content of the requested page. If parsing is enabled, you'll also receive a structured JSON object of the data.

The entire code can be found here: Please star and follow me on GitHub.

What's Next?

This article is just the beginning of your journey with Nimble API. In our upcoming video and blog series, we'll dive deeper into how to leverage the different APIs for specific use cases. Stay tuned for more insights, tips, and tutorials on unlocking the full potential of Nimble API.

Ready to embark on your web data adventure? Subscribe to stay updated and get ready to harness the power of Nimble API. Your web data journey starts here!