Skip to the content...

Welcome to the David Walsh Blog. I'm a MooTools, Dojo, jQuery, CSS, and PHP Web Developer located in Madison, Wisconsin, United States. Please contact me if I can make your experience on my website better.

Simple PHP Caching and Content Retrieval Function

8 Responses »

One way to make your website exponentially faster is by caching both remote and internal requests. Why request your RSS subscriber count from FeedBurner more than once a day if that count is calculated once per day? Why hit your database on each page load if that content rarely changes? I've created a primitive request-and-cache function for PHP that checks for fresh content in the cache and retrieves content from a source if fresh content isn't available.

The PHP Function

/* gets the contents of a file if it exists, otherwise grabs and caches */
function get_content($file,$url,$hours = 24,$fn = '',$fn_args = '') {
	//vars
	$current_time = time(); $expire_time = $hours * 60 * 60; $file_time = filemtime($file);
	//decisions, decisions
	if(file_exists($file) && ($current_time - $expire_time < $file_time)) {
		//echo 'returning from cached file';
		return file_get_contents($file);
	}
	else {
		$content = get_url($url);
		if($fn) { $content = $fn($content,$fn_args); }
		$content.= '';
		file_put_contents($file,$content);
		//echo 'retrieved fresh from '.$url.':: '.$content;
		return $content;
	}
}

/* gets content from a URL via curl */
function get_url($url) {
	$ch = curl_init();
	curl_setopt($ch,CURLOPT_URL,$url);
	curl_setopt($ch,CURLOPT_RETURNTRANSFER,1); 
	curl_setopt($ch,CURLOPT_CONNECTTIMEOUT,5);
	$content = curl_exec($ch);
	curl_close($ch);
	return $content;
}

My get_content function accepts four arguments:

  • The file to grab content from. If the file doesn't exist, the file is created and content placed into.
  • The URL to get content from if cached content isn't fresh.
  • A function name to pass the freshly received content to.
  • Arguments to pass to the third argument's function.

The function is, of course, very primitive. I like that my function handles both retrieval and caching so that I don't need to repeat code whenever I want cached content.

Sample Usage 1

/* usage */
$TWITTER_FOLLOWERS_FILE_NAME = 'twitter-followers.txt';
$TWITTER_FOLLOWERS_URL = 'http://twitter.com/users/show.json?screen_name=davidwalshblog';

$TWITTER_FOLLOWERS = get_content($TWITTER_FOLLOWERS_FILE_NAME,$TWITTER_FOLLOWERS_URL,3,'format_followers',array('file'=>$TWITTER_FOLLOWERS_FILE_NAME));
/* utility function */
function format_followers($content,$args) {
	$content = json_decode($content);
	$twitter_subscribers = $content->{'followers_count'};
	if($twitter_subscribers) {
		$twitter_subscribers = number_format($twitter_subscribers,0,'',',');
		file_put_contents($args['file'],$twitter_subscribers);
		return $twitter_subscribers;
	}
}

The above code retrieves my Twitter follower count, parses the code, and caches the content for three hours.

There are several more advanced PHP caching classes available but the simple function above covers most of my needs -- hopefully it can help you out too!

Discussion

  1. hervé
    December 10, 2009 @ 2:40 pm

    Why don’t you simply use something simple like pear cache lite ?

  2. December 10, 2009 @ 3:21 pm

    Hi,
    ever thought about memcached? Its a nice daemon, which can store such things in memcache, its very easy to usw and very efficient. Many big sites use it, facebook has about 800 Memcached-Servers.

  3. chris the developer
    December 10, 2009 @ 6:24 pm

    @herve + michael: Simply put, this approach allows the developer to cache without having to set the environment up to use memcache or pear cache lite….

  4. December 10, 2009 @ 6:46 pm

    Thank you! I was looking for something like this yesterday. Exactly what I needed.

  5. December 10, 2009 @ 7:36 pm

    Basic caching like this is really useful when dealing with APIs, but I wish WordPress would add some centralized caching functions. It would make things neater than dumping data into assorted wp_options fields…

  6. December 10, 2009 @ 9:47 pm

    I must say that i like this blog very much. I’m pretty interested in mootools because i’m in the process of creating javascript UIs. This tutorial is also very nice. It’s a good habit to cache whatever is possible.

  7. December 11, 2009 @ 8:23 am

    Nice function.
    I’ll be looking to build something similar, but with images created dynamically… Check if image exist and check if image is “recent”… else regenerate the image.

    I allready did something similar with an XML generator, so users cannot spam the website to generate a new XML every time.

    Caching is something useful when controlled… but can be a pain when you don’t know stuff is cached (ka-Map comes to mind…)!

  8. June 3, 2010 @ 2:23 pm

    Zend Framework (Zend_Http & Zend_Cache) ^^!

    And… a few small suggestions:

    * is_file instead file_exists: No warnings and not @ supress errors operator.
    * strtotime(‘text’) instead calculate hours: More intuitive.
    * register_shutdown_function for caching new content, after
    the first petition and the file creation if not exists: No delay, no http errors for dump the file content.

    I used this at betools.culturadigital.org ;)

Be Heard!

Share your thoughts with fellow developers of all skill levels! I want to hear from you!

Name*:
Email*:
Website:  
Wrap your code with <code> tags, f00!