How to Use the Twitter/X Profile Scraper

Step 1: Provide profile URLs

You can give your input in one of two ways:

1. My Lists:
   Choose a saved LinkedIn Leads list you’ve already created in PhantomBuster.
2. A URL:
   • Paste a single X/Twitter profile URL.
   • Paste the URL of a Google Sheet with your X/Twitter profile URLs (make sure it’s shared with “Anyone with the link”).
   • Or upload a CSV file with your X/Twitter profile URLs (make sure it’s publicly accessible, and note that CSV upload is only available on paid plans).

→ If you’re using a spreadsheet, the Phantom defaults to the first column (A). To use a different column, enter the column’s header name in the field “Column name containing profile URLs.”

Step 2: Connect your X/Twitter account

To let the Phantom act on your behalf:

1. Install the PhantomBuster browser extension and connect your X/Twitter session in one click.
2. If you’re not using Chrome or Firefox, you can retrieve your session cookie manually (see our cookie guide).

Step 3: Set extraction limits

• Number of profiles to scrape per launch (optional):
  • Default = 60.
  • We recommend extracting a maximum of 60 profiles per day, adjusting based on how warmed up your account is.
  • If left empty, the Phantom processes up to 60 profiles.

Result file settings (dropdown in setup)

1. Name your results file (optional)

   • You can customize the file name.

     If you rename the file between launches, the Phantom will create a new results file and start processing inputs from scratch.

2. Fields to keep (optional)
   • Export only the fields you care about by listing them (comma-separated).
     Example: profileUrl, job, location.
   • This generates a second CSV file with just those fields.
   • Learn more in our guide: Customize how your Phantom results files are saved.

Step 4: Select launch frequency

Choose how often the Phantom should run:

1. Launch manually: Start the Phantom yourself whenever you need.
2. Launch once at a specific time: schedule a one-time run at a set date and time.
3. Launch repeatedly: schedule regular runs (e.g. once per day, several times during working hours).
4. Launch after another Phantom: chain automations together so this Phantom starts right after another finishes.
5. Advanced scheduling: customize the exact minutes, hours, days, or months when the Phantom should run.

→ For a complete walkthrough of scheduling options, see our guide to scheduling Phantoms automatically.

Step 5 (Optional): Advanced settings

Advanced settings are available if you want to fine-tune how your Phantom runs, but by default they’re already optimized for most use cases.

We recommend leaving them as they are unless a guide specifically instructs you to change something.

→ For a detailed overview of all advanced options (like execution limits, retries, email notifications, proxies, webhooks, and file management), see our Advanced settings guide.

Launch and results

When you’re ready:

1. Click Launch to start your Phantom.
2. Once it finishes, open the Results tab in the Phantom console to see extracted X/Twitter profiles and fields (handle, display name, bio, followers, etc.).
3. Download your results as a CSV or JSON file.

→ To learn how to export your data to Google Sheets, integrate with other tools, or reuse it in more automations, check our Access and Export your Phantom Results guide.

Export and input limits on the Free plan
If you’re on the Free plan or Free trial, some features are limited:
- CSV exports include only the first 10 rows of results.
- CSV download links (for dynamic viewing in Google Sheets or integrations) are not available.
- JSON exports are not available.
- CSV upload as an input method is not supported.
To unlock all features, you’ll need to upgrade to a paid plan.

What you give (Input) and What you get (Output)

This section gives you a detailed breakdown of everything you need to provide to run this Phantom, and everything you’ll receive once it completes.

What you give (Input)

What you get (Output)

Tips and troubleshooting

Common pitfalls

• Using a private spreadsheet (make sure it’s set to “Anyone with the link”).
• Private accounts → data from locked X/Twitter profiles can’t be extracted.

If you run into issues

• Check how to troubleshoot your phantom using Logs.
• Browse the Fix Issues & Troubleshoot Errors section for solutions to common problems.
• Review our Automation Rate Limits by Platform guide.
• Check our Best Practices for Social Media Automation guide.

Suggested automations

• Twitter Auto Follow → Follow the profiles you’ve scraped.
• Twitter Message Sender → Send personalized DMs to the profiles you’ve collected.
• Twitter Media Extractor → Gather media (images, videos) from the profiles you’ve extracted.