// Improved get_handle() with double-check UserProfile* get_user_profile_handle_safe(int user_id) { pthread_mutex_lock(&cache_lock); CacheEntry *entry = g_hash_table_lookup(handle_cache, &user_id); if (entry) { entry->ref_count++; pthread_mutex_unlock(&cache_lock); return entry->profile; } pthread_mutex_unlock(&cache_lock); // Load outside lock UserProfile *profile = load_user_profile_from_disk(user_id);
This article breaks down the key components, implementation strategies, and concurrency considerations for building a robust handle cache in C. Imagine a function get_user_profile(user_id) that reads a large JSON file from disk or queries a database. If your application needs this profile multiple times per second, disk I/O or network latency becomes a bottleneck. handle-with-cache.c
pthread_mutex_unlock(&cache_lock); } The cache_lock mutex protects the hash table, but note that get_handle() releases the lock during the actual load_user_profile_from_disk() call. This is crucial to avoid blocking all threads during I/O. However, it introduces a race condition where two threads might simultaneously miss the cache and both load the same resource. A common optimization is or using a per-key
A common optimization is or using a per-key mutex: unsigned int ref_count
// Cache miss - load the resource pthread_mutex_unlock(&cache_lock); // Unlock during I/O UserProfile *profile = load_user_profile_from_disk(user_id); pthread_mutex_lock(&cache_lock);
// Cache entry wrapper typedef struct { UserProfile *profile; time_t last_access; unsigned int ref_count; // Reference counting for safety } CacheEntry;
// Background thread or called periodically void evict_stale_handles(int max_age_seconds, int max_size) { pthread_mutex_lock(&cache_lock); time_t now = time(NULL); GList *to_remove = NULL;