Search for a command to run...
How to Generate Nimble API keys and perform your first Web Scraping
My name is Ronnie & a fellow geek like you😎. I am passionately tech curious.
I blog, tweet, write, code, vlog, discuss and eat anything about tech.
😍 Feel Free To Connect 😍
No comments yet. Be the first to comment.
In this series, I will teach you on how to use Nimble for data scraping and extraction.
The Era of Prompt-Driven Development Let me start with a bold statement: I no longer need to code if I'm good at prompting & problem solving... This isn't hyperbole, it's the reality of 2026. Over the past 6 days, I completely rebuilt my portfolio we...
Imagine This… Imagine an AI system that doesn’t just answer questions, but understands the world well enough to predict what will happen next. Not just what words come after another word,but what happens after it rains,what happens when traffic build...
Internet shutdowns are no longer rare events. From election periods and protests to infrastructure failures and policy decisions, millions of people, especially in Africa, experience a sudden loss of internet access every year. For students, entrepre...
Lessons, Laughs, and Life Hacks
As someone who has participated in over 45 hackathons since 2021, I’ve come to appreciate how impactful these experiences can be, not just for winning prizes, but for building real-world skills, expanding your network, and launching your tech career....
Are you ready to unlock the power of web data collection and automation? Nimble API is your all-in-one platform that simplifies the process of accessing, collecting, and delivering web data. Whether you're an SEO specialist, data analyst, AI developer, or sales professional, Nimble API empowers you to harness the vast ocean of web information. In this introductory guide, we'll explore what Nimble API has to offer and how to begin your journey into the world of web data.
Nimble API is your versatile companion for a range of web data collection needs. With just a URL and some basic parameters, Nimble API can create powerful web data pipelines for:
SERP Collection: Dive deep into search engine results pages (SERPs) for comprehensive SEO/SEM analysis.
E-Commerce Data: Access product data from the largest online marketplaces with ease, making price monitoring and product comparison a breeze.
AI Model Training: Gather training and parameter data to fuel your AI models and machine learning algorithms.
Sales Boost: Enrich your leads with valuable data, making your sales efforts more efficient and effective.
And this is just the beginning. Nimble API is designed to be flexible and adaptable to various use cases, making it a valuable tool for businesses and individuals alike.
Nimble API encapsulates the entire data collection process into a unified package, simplifying the journey from URL to actionable data. Here's how it works:
Accessing Any URL: Nimble API can access any public URL on the web, giving you the freedom to explore the vast web landscape.
Collecting Web Data: It collects a wide range of web data, including text, images, and more, transforming the web into a valuable data source.
Parsing Data: Nimble API parses the collected data into usable JSON structures, making it easy to integrate into your workflows.
Multiple Storage Options: Choose from multiple storage options to store and manage your valuable data.
Nimble API offers a suite of powerful APIs to cater to your specific data collection needs. These include:
Web API: Your gateway to accessing web data from any public URL.
SERP API: Dive into search engine results for SEO/SEM analysis.
Places API: Access location-based data for geospatial analysis.
E-Commerce API: Gather product data from online marketplaces for competitive insights.
Getting started with Nimble API is a breeze, thanks to its user-friendly interface and detailed documentation.
Before you begin, ensure to have Python Installed on your machine. Have an account created on the Nimble platform and you can access this dashboard.
Here's a quick overview of the steps to begin your web data journey:
Nimble API uses Basic access authentication for every request. To authenticate, generate a base64 encoded credential string using your Nimble credentials. For example:
import base64
auth = 'username@example.com:yourpassword'
encoded_bytes = base64.b64encode(auth.encode('utf-8'))
# Convert the bytes to a string
nimble_auth = encoded_bytes.decode('utf-8')
#Incase you want to see it!
print(nimble_auth)
Once you have your credential string, apply it to the header of every request.
Real-time requests to the Web API are made using the https://api.webit.live/api/v1/realtime/web endpoint. You'll need to send the credential string with every request to authenticate your account.
import requests
url = 'https://api.webit.live/api/v1/realtime/web'
headers = {
'Authorization': f'Basic {nimble_auth}',
'Content-Type': 'application/json'
}
data = {
# Add your parameters here
"url": "https://www.octachart.com",
"method": "GET",
"parse": False,
"render": True,
"country": "CA",
"locale": "en-GB",
"headers": {
"Some-Extra-Header": "Some-Extra-Header"
}
}
response = requests.post(url, headers=headers, json=data)
print("NIMBLE STATUS ", response.status_code)
The only required parameter is the "URL," defining the address from which to collect data. Additional parameters, such as geolocation targeting and custom headers, can be added for more specific data collection needs.
If successful, the Web API will return 200 OK status with structured data, including the HTML content of the requested page. If parsing is enabled, you'll also receive a structured JSON object of the data.
The entire code can be found here: Please star and follow me on GitHub.
This article is just the beginning of your journey with Nimble API. In our upcoming video and blog series, we'll dive deeper into how to leverage the different APIs for specific use cases. Stay tuned for more insights, tips, and tutorials on unlocking the full potential of Nimble API.
Ready to embark on your web data adventure? Subscribe to stay updated and get ready to harness the power of Nimble API. Your web data journey starts here!