Set Up a Proxy: When And Why You Should Use One

December 02, 2019 11:32

This guide will help you understand what proxies are, how they work, and how they can benefit you. It will also provide step-by-step instructions on using proxies with PhantomBuster.

What is a proxy?

A proxy is a server application that stands in between your requests for information available on the internet and the websites providing the answers.

When you are navigating a website, say LinkedIn, and look at someone's profile, you are making a request to the LinkedIn server to provide you with that information. This server has access to your IP address and location, meaning if you make multiple requests at the same time from different locations, LinkedIn can detect that this might not be you.

A proxy will give you a fixed IP address, making automated actions harder to detect by websites that track if you have a consistent IP address to confirm that you are making requests.

How do proxies work?

💡 Using a proxy helps mask the IP address of the server running your automation, reducing the chances of websites flagging your activity due to inconsistent login locations.

When you run an automation without a proxy, your requests go directly to the website you're automating on. With a proxy, your automation's requests first go to the proxy server.

The proxy then forwards the request to the website, and the website sends the information back to the proxy, which finally sends it to your automation.

This way, the website only sees the IP address set by the proxy, not the IP address of the PhantomBuster server running your automation.

When do you need to use proxies when automating with PhantomBuster?

⚠️ All PhantomBuster automations run in the cloud. This means Phantoms and Flows may operate from a different geographical location than your own, making the use of proxies a must in specific cases.

Not all automations require the use of a proxy. Here are some situations where using a proxy is important:

Facebook automations: Facebook is very strict in monitoring the IP addresses of its users and flags accounts when the IP address changes. A proxy ensures that your automation appears to operate from a fixed location, preventing your account from being flagged or blocked.

⚠️ Using a proxy is crucial for Facebook Phantoms as automations won't work without a consistent IP address.

Google Maps and Yellow Pages automations: Both Google Maps and Yellow Pages results are location-specific. If you search for “recruitment agencies on Google Maps in Paris” from Paris or from somewhere in the USA, the results may differ. Using a proxy ensures that you get accurate and relevant results as if you were searching from the desired location.

How to set up a proxy in PhantomBuster?

PhantomBuster supports both internal and external proxies. Here’s how you can set up each type.

Setting up an internal PhantomBuster proxy

💡 Internal proxies are managed by PhantomBuster and are ideal for quick setup. Note that internal proxies need to be set up for each Phantom you intend to use with a proxy.

Go to your Dashboard and locate the Phantom/ Flow you want to configure with proxy.
Click on the 3 dots in Phantom card, then click on Setup.
At the bottom left of the Settings menu, click on Advanced settings.
Select the option to use an internal proxy. Then choose Maintain the same fixed IP as long as it's available and select a Proxy location from the dropdown list to set the IP address.
Click Save settings to apply the internal proxy settings to this automation.

⚠️ PhantomBuster internal proxies are located in Québec (Canada), Hauts-de-France (France), England (UK), Virginia (USA), and Oregon (USA). If you're not near these locations, consider using an external proxy.

Setting up an external proxy pool on PhantomBuster

⚠️ Not all proxies provide the same level of privacy and security. Choose a reputable service to ensure your data is protected. We recommend using Bright Data for reliable and secure proxy services.

💡Store external proxy information on your account to use it with multiple Phantoms and Flows.

Pick a reliable external proxy service. We recommend using Bright Data for reliable and secure proxy services.
Go to your Dashboard.
Click on your profile icon for the Settings menu to open and select Proxies.
Clicking on + New proxy pool and name it anything you like.
Fill in the proxy information you got from your proxy service and click Add proxy to save.

⚠️ Ensure that your proxy username and password do not contain special characters like "@" or "#", as this can cause the Phantom to malfunction.

Untitled (6).jpeg

Go to the advanced settings in the Settings step of your Phantom's setup to link the proxy.

Untitled (7).jpeg.png

Setting up an external single-use HTTP proxy on PhantomBuster

💡 Select the 'HTTP' option if you only need a proxy for a single Phantom.

Go to your Dashboard and locate the Phantom/ Flow you want to configure with ‘HTTP’ proxy.
Click on the 3 dots in Phantom card, then click on Setup.
At the bottom left of the Settings menu, click on Advanced settings.
Select the option to use HTTP proxy. Then fill in the proxy details: Address, Username and Password.
Click Save settings to apply the internal proxy settings to this automation.