Cant get the html dom by php curl. - php

Question

I have used php CURL to get the html or echo the html. But it is suddenky redirecting, when i am trying with this code.
$cookie = tempnam ("/tmp", "CURLCOOKIE");
$ch = curl_init();
function get_data( $ch, $url, $post, $cookie ){
$agent = "Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 Firefox/1.0.7";
curl_setopt($ch, CURLOPT_URL, $url);
curl_setopt($ch, CURLOPT_USERAGENT, $agent);
//curl_setopt($ch, CURLOPT_COOKIEFILE, $cookie);
curl_setopt($ch, CURLOPT_COOKIEJAR, $cookie);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 0);
curl_setopt($ch, CURLOPT_FOLLOWLOCATION, 0);
curl_setopt($ch, CURLOPT_HEADER, 0);
curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, 1);
curl_setopt($ch, CURLOPT_SSL_VERIFYHOST, 2);
if( $post != '' )
curl_setopt($ch, CURLOPT_POSTFIELDS, $post);
return curl_exec($ch);
}
$url = 'https://iapps.courts.state.ny.us/webcivil/FCASSearch?param=I';
$html = get_data( $ch, $url, '', '' );
echo $html; exit;
I have played with these
CURLOPT_RETURNTRANSFER,
CURLOPT_FOLLOWLOCATION,
CURLOPT_COOKIEJAR,
CURLOPT_COOKIEFILE
But still i got redirection when trying to get the html. How can i get the HTML of the page or is there any other thing try ?

Answer 1

Here is a fixed working code to grab the code of the page.
$cookie = tempnam ("/tmp", "CURLCOOKIE");
$ch = curl_init();
function get_data( $curl, $url, $post, $cookie ){
$agent = "Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 Firefox/1.0.7";
curl_setopt($curl, CURLOPT_URL, $url);
curl_setopt($curl, CURLOPT_USERAGENT, $agent);
curl_setopt($curl, CURLOPT_COOKIEFILE, $cookie);
curl_setopt($curl, CURLOPT_COOKIEJAR, $cookie);
curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);
curl_setopt($curl, CURLOPT_FOLLOWLOCATION, 0);
curl_setopt($curl, CURLOPT_HEADER, 0);
curl_setopt($curl, CURLOPT_SSL_VERIFYPEER, false);
curl_setopt($curl, CURLOPT_SSL_VERIFYHOST, 2);
if( $post != '' )
curl_setopt($curl, CURLOPT_POSTFIELDS, $post);
return curl_exec($curl);
}
$url = 'https://iapps.courts.state.ny.us/webcivil/FCASSearch?param=I';
$html = get_data( $ch, $url, '', '' );
echo htmlspecialchars($html);
But have you seen what you get on this? Almost only JS
which doesnt seem to be very usefull to parse.

Answer 2

You can take idea from this code. Give a path to page from which you want to get html content in live_url.
$live_url = "http://www.example.com/page/header.php";
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $live_url);
curl_setopt($ch, CURLOPT_TIMEOUT, 1000);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
$content = curl_exec($ch);
$res = curl_getinfo($ch);
curl_close($ch);
echo $content;