A Python script to warm up URLs and check cache performance by sending GET requests in parallel.

This tool sends HTTP GET requests to a list of URLs to warm up the cache and determine whether the responses come from cache (HIT) or are fresh requests (MISS). It supports multiple configuration profiles to test different headers and cookies.

• Python 3.6+
• Required Python packages (install with pip install -r requirements.txt):
  • requests 🌐
  • rich 🎨
  • concurrent.futures ⚡

python warmer.py --files <csv_file1> [<csv_file2> ...] [--threads <number_of_threads>] [--timeout <timeout_in_seconds>] [--config-file <config_file_path>]

The script expects a config.json file in the current directory with the following structure:

[
  {
    "name": "Configuration 1",
    "headers": {
      "User-Agent": "CacheWarmer/1.0"
    },
    "cookies": {
      "session_id": "abc123"
    }
  },
  {
    "name": "Configuration 2",
    "headers": {
      "Authorization": "Bearer token123"
    },
    "cookies": {}
  }
]

Each configuration object can define:

• name: A descriptive name for the configuration
• headers: HTTP headers to include in requests
• cookies: HTTP cookies to include in requests

The script supports loading configurations from a custom file using the --config-file command-line argument. If no --config-file is specified, it defaults to loading from config.json.

Each CSV file should contain one URL per line in the first column:

https://example.com/page1
https://example.com/page2
https://example.com/page3

Logs are written to warmer.log pointing all execution errors. No separate log files are created by default. If you need to redirect logs to a file, you can do so using shell redirection:

python warmer.py --files urls.csv > app.log 2>&1

The script displays:

1. 📈 Progress bars for each configuration stage
2. 📊 Summary panels for each configuration
3. 📋 Final aggregate summary table

python warmer.py --files urls.csv --threads 10 --timeout 15 --config-file custom_config.json

This will:

• Read URLs from urls.csv
• Warm up each URL using 10 parallel threads
• Apply configurations from custom_config.json (or config.json if not specified)
• Show progress and results in the terminal

• Parallel Processing: Efficiently test multiple URLs simultaneously
• Configurable Headers: Test different HTTP headers and cookies
• Visual Progress: Real-time progress indicators with rich UI
• Detailed Reporting: Clear HIT/MISS distinction and performance metrics
• Flexible Input: Support for multiple CSV files and configurations

⚠️ This tool is for testing and development purposes only. Ensure you have proper authorization before testing external systems.