Discusses management of compressed log files.
If you are analyzing a log file that you must access using FTP, you will need to physically transfer that log file to a local drive. You can either use your Webtrends Analytics software to take care of the log file transfer, or you may set up your own procedure to bring the log files over before running the analysis. After the log file is stored locally, you can use the Webtrends Analytics software to unzip the compressed file, or you can set up your own process. Either way, after you move the log file to your local drive, you must decide how long to store it. Just as with uncompressed web data, this decision depends on how often you expect to re-analyze the log file, how much data the log file contains (which affects how long it takes to transfer the log file using FTP), and how much local storage space you can afford to allocate.
Consider the following choices for handling your FTP cache:
- Delete the file from the cache after analysis completes.
- Keep the file in the cache for a specified number of days.
- Keep the file in the cache until the cache reaches a maximum size, at which point the oldest files in the cache will be replaced by new, incoming files.
- Keep the file in the cache, but delete the file if it is not accessed within a specified period of days.