Skip to main content

Documentation Index

Fetch the complete documentation index at: https://help.lobstr.io/llms.txt

Use this file to discover all available pages before exploring further.

A Squid is a scraping job in lobstr.io. Each Squid is configured to target a specific data source — Google Maps, LinkedIn, Twitter/X, and so on — and collects structured data whenever it runs. You can launch Squids manually on demand or schedule them to run automatically on a recurring basis.

Creating a Squid

1

Log in to your dashboard

Go to app.lobstr.io and log in.
2

Click Create a new Squid

From your dashboard, click the Create a new Squid button.
3

Pick a scraper

Search for the scraper you want to use and click it. The Squid is created and opens in your dashboard, ready to configure.

Renaming a Squid

lobstr.io assigns a default name when you create a Squid. You can rename it at any time to keep your dashboard organized.
1

Open your Squid

Go to your dashboard and click any Squid in the list.
2

Open Settings

Click the Settings icon at the top of the Squid page.
3

Rename the Squid

Click the current name at the top of the Settings panel and type the new name.
4

Save your changes

Click Save & Exit to apply.

Scheduling

You can schedule a Squid to launch automatically on a recurring basis — every few minutes, hours, days, weeks, or on specific dates each month. See Scheduling for the full guide.

Run history

Every Squid keeps a full log of its runs in the Runs table beneath the live console. For the details on run statuses, timings, credits used, aborting, and everything the Runs table shows, see Runs.
Run data is stored for 28 days on paid plans and 7 days on the free plan. Download or export results before they expire. See How to Download Results.