LinkedIn Scraper

Overview

This skill finds LinkedIn job postings by running tools/jobspy_scraper.py, a thin wrapper around the JobSpy library. It handles installation, parameter construction, execution, and result interpretation.

Quick Start

Install the dependency once (requires Python 3.10+):

python3.12 -m pip install -U python-jobspy --break-system-packages

Run the scraper:

python3.12 tools/jobspy_scraper.py \
  --search "software engineer" \
  --location "San Francisco, CA" \
  --results 25 \
  --output .tmp/jobs.csv

Results are saved as CSV and printed as a summary table.

---

Workflow

Step 1 — Understand the request

Identify from the user's message:

• Search term — job title, role, or keyword (required)
• Location — city, state, or "Remote" (optional but recommended)
• Results wanted — default to 25 if not specified
• Recency — hours_old filter if user wants recent posts (e.g. "last 48 hours")
• Company filter — linkedin_company_ids if targeting a specific company
• Full descriptions — set --fetch-descriptions if user needs job description text

If anything is ambiguous (e.g. "find AI jobs"), pick reasonable defaults and tell the user what you used.

Step 2 — Construct the command

Build the tools/jobspy_scraper.py command using the parameters below. Always save output to .tmp/ so it's disposable and easy to find.

python tools/jobspy_scraper.py \
  --search "<term>" \
  --location "<location>" \
  --results <N> \
  [--hours-old <N>] \
  [--fetch-descriptions] \
  [--company-ids <id1,id2>] \
  [--job-type fulltime|parttime|contract|internship] \
  [--remote] \
  --output .tmp/<descriptive_filename>.csv

Note: --hours-old and --easy-apply cannot be used together (LinkedIn API constraint).

Step 3 — Run the script

Execute the command. The script will print a progress message and a summary of results found.

If the script is not found at tools/jobspy_scraper.py, check whether the file needs to be created by reading skills/linkedin-job-scraper/scripts/jobspy_scraper.py and copying it to tools/.

Step 4 — Interpret and present results

After the run:

• Report how many jobs were found
• Show a brief table: Title | Company | Location | Salary | Posted
• Note the output file path so the user can open it
• If 0 results: suggest broadening the search term or removing the location filter

---

Parameters Reference

Flag	Description	Default
--search	Job title / keywords	required
--location	City, state, or country	none
--results	Number of results to fetch	25
--hours-old	Only jobs posted within N hours	none
--fetch-descriptions	Fetch full job descriptions (slower)	false
--company-ids	Comma-separated LinkedIn company IDs	none
--job-type	fulltime, parttime, contract, internship	any
--remote	Filter for remote jobs only	false
--output	Path for CSV output	.tmp/jobs.csv

---

Output Columns

The CSV output includes:

Column	Description
TITLE	Job title
COMPANY	Employer name
LOCATION	City / State / Country
IS_REMOTE	True/False
JOB_TYPE	fulltime, contract, etc.
DATE_POSTED	When the listing was posted
MIN_AMOUNT	Minimum salary
MAX_AMOUNT	Maximum salary
CURRENCY	Currency code
JOB_URL	Direct link to the LinkedIn posting
DESCRIPTION	Full job description (if --fetch-descriptions used)
JOB_LEVEL	Seniority level (LinkedIn-specific)
COMPANY_INDUSTRY	Industry classification

---

Common Use Cases

Find recent engineering roles at a startup:

python tools/jobspy_scraper.py --search "growth engineer" --location "New York" \
  --results 50 --hours-old 72 --output .tmp/growth_eng_nyc.csv

Monitor what a specific company is hiring for:

# First find the LinkedIn company ID from the company's LinkedIn URL
python tools/jobspy_scraper.py --search "engineer" --company-ids 1234567 \
  --results 100 --fetch-descriptions --output .tmp/company_hiring.csv

Find remote contract roles:

python tools/jobspy_scraper.py --search "data analyst" --remote \
  --job-type contract --results 30 --output .tmp/remote_contracts.csv

---

Error Handling

Error	Fix
ModuleNotFoundError: jobspy	Run pip install -U python-jobspy
0 results returned	Broaden search term, remove location, increase --results
Rate limited / blocked	Wait a few minutes; avoid running back-to-back large scrapes
hours_old and easy_apply cannot both be set	Remove one of those flags

---

Script Location

The scraper script lives at tools/jobspy_scraper.py.

If it doesn't exist, copy it from skills/linkedin-scraper/scripts/jobspy_scraper.py to tools/:

cp skills/linkedin-job-scraper/scripts/jobspy_scraper.py tools/