Hey everyone, good to see you all

Ive been trying to remove the session id from a url so my crawler doesnt think theres an unlimite amount of pages but my code isnt working so well.
My code is:

PHP Code:

<?php //Session ID  removal //cant have same name
function remove_session_id($full_url) {
    find_session();
}

function find_session() {
    global $linksarray;
    
    foreach($linksarray as $value) {
        $array = preg_split("[\?|\&amp;]",$value);

        foreach($array as $other_value) {
                
            $get_array = explode('=',$other_value); //Splits the $_GET name from the $_GET data
            $search = eregi('[abcdef0-9]',$get_array[1]); //Looks for $_GET information with 0-9 & A_F
                
            if($search == true || $search === true) {
                echo('potential session id found/n');
            } else {
                break;
                return false;
            }
        }
    var_dump($array); //debug*/
    }
} ?>

Can anyone maybe help me? i need to remove a 32 long string full of 0-9 and a-f.

Thanks

If you want to actually remove the sid completely, you can do something like this:

PHP Code:

<?php
function find_session() {
    global $linksarray;
    
    foreach($linksarray as $key => $value) {
      $str = preg_replace('#sid=[abcdef0-9]{32}#',"",$value);
      $str = preg_replace('#(\?|\&(amp;)?)\&(amp;)?#',"\\1",$str);
      $linksarray[$key] = preg_replace('#\?$#',"",$str);
    }
    
} 

$linksarray = Array(
"http://www.something.com?sid=abd6e7f8c9e0adc9e7f8b9037dbe7293&amp;one=one&two=two",
"http://www.something.com?three=three&amp;sid=abd6e7f8c9e0adc9e7f8b9037dbe7293&amp;one=one&amp;two=two",
"http://www.something.com?sid=abd6e7f8c9e0adc9e7f8b9037dbe7293"
);
echo "<pre>";
print_r($linksarray);

find_session();

print_r($linksarray);
echo "</pre>";
?>

That code results in the output:

Array
(
    [0] => http://www.something.com?sid=abd6e7f8c9e0adc9e7f8b9037dbe7293&one=one&two=two
    [1] => http://www.something.com?three=three&sid=abd6e7f8c9e0adc9e7f8b9037dbe7293&one=one&two=two
    [2] => http://www.something.com?sid=abd6e7f8c9e0adc9e7f8b9037dbe7293
)
Array
(
    [0] => http://www.something.com?one=one&two=two
    [1] => http://www.something.com?three=three&one=one&two=two
    [2] => http://www.something.com
)

(My browser flattened the &amp s into plain & when rendered).

stick the following two lines in your .htaccess file

php_value session.use_only_cookies 1 
php_value session.use_trans_sid    0

What? how will that help my crawler?

Sorry, It's been a long day. I thought you wanted to remove the session ID's from your urls so they can be crawled. I didn't realize you were writing the crawler.

My apologies

Thanks everyone, it now removes session id's