FileInfoPollerServer lookback exceeds limit leads to reprocessing f…

…iles (#855)

* break out file poller store into trait for testing

* fix reprocessing files when more than the limit arrives within the lookback offset

When the cleaning process is triggered, it will get the timestamp of the
100th oldest file that has been processed. If that time is greater than
the lookback offset, we will only remove files older than the lookback.
Otherwise, we will remove any file older than the 100th entry.

- add cache clean logging
- break out getting FileInfo from s3 with `FileInfoPollerStore` trait

* move file-store to the CI job that needs a postgres container for tests

`FileInfoPollerServer` has a test that uses a database now.

.github/workflows/CI.yml

@@ -92,7 +92,7 @@ jobs:
     strategy:
       fail-fast: false
       matrix:
-        package: [boost-manager,iot-config,iot-packet-verifier,iot-verifier,mobile-config,mobile-verifier]
+        package: [boost-manager,file-store,iot-config,iot-packet-verifier,iot-verifier,mobile-config,mobile-verifier]
     concurrency: 
       group: ${{ github.workflow }}-${{ github.ref }}-tests-postgres-${{ matrix.package }}
       cancel-in-progress: true
@@ -142,7 +142,7 @@ jobs:
     strategy:
       fail-fast: false
       matrix:
-        package: [coverage-map,coverage-point-calculator,file-store,ingest,mobile-packet-verifier,reward-scheduler,task-manager]
+        package: [coverage-map,coverage-point-calculator,ingest,mobile-packet-verifier,reward-scheduler,task-manager]
     concurrency: 
       group: ${{ github.workflow }}-${{ github.ref }}-tests-${{ matrix.package }}
       cancel-in-progress: true