Set the User Agent With PHP cURL

Discussion

1. Henry Dominik

   Thanks for this tip. Was working on a project and found your tip very handy.
2. Matt Fletcher

   Thanks for this! Was needed for a wikipedia curl request.
3. Oyun Plus

   Thanks for this, it for me too.
4. nirzari

   hi..
   How to check whether a user agent string is supported by all the urls or not ? I have tried many urls with different user agent strings but I couldn’t find any user agent which is supported by all urls. When a user agent string is not supported, I get 0 (zero) as http response code and null as mime type. Please help.
5. Mohammad Ali Akbari

   Thanks, without setting user agent I was getting this error:

   at nl.bitwalker.useragentutils.Browser.isInUserAgentString(Browser.java:154)
6. Brilliand

   “for security purposes”… that’s incredibly weak security. I think it’s more common for the website to be doing useragent sniffing (to tailor the response to the browser), and simply not bothering to support uncommon useragents.
7. David

   perfect – thank for the tip!
8. MJ

   Thank, that helped!
9. hesus

   i get error code like this. curl_setopt() expects parameter 1 to be resource, null given in /home/xxxx/xxxxx
10. Biswadeep

    Try this…

    function scrap($url)	{
    	$curl = curl_init($url);
    
    	curl_setopt($curl, CURLOPT_USERAGENT, "My User Agent Name");
    	curl_setopt($curl, CURLOPT_FAILONERROR, true);
    	curl_setopt($curl, CURLOPT_FOLLOWLOCATION, true);
    	curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);
    
    	$html = curl_exec($curl);
    	curl_close($curl);
    
    	return $html;
    }
    

    You are getting the error as curl_setopt() required first parameter as a resource returned by the curl_init($url);
11. Will Etling

    This, in fact, just got me out of a jam.
12. Jim

    Almost a full 10 years later and this post just really helped me out! Thanks!