Reduce storage taken by artifacts

Description

Artifacts are the first culprit for space consumed by our builds. We should enable a mechanism to save artifacts on normal builds only on demand for example by including the required artifacts in the commit message.
Right now we have [skipCI] but we can have something similar for artifacts
Ex: [Artifacts: opennms-ubuntu, opennnms-pi]

Merge Builds artifacts may be addressed on a separate ticket. 

Acceptance / Success Criteria

None

is triggered by

Lucidchart Diagrams

Activity

Morteza August 8, 2022 at 5:35 PM

We have reduced the number of days artifacts, cache and workspace are kept.

 

I'm closing this item and we can revisit it once the dynamic yaml file generation work has been delivered

Morteza July 21, 2022 at 6:38 PM

I have stopped working on this item until we hear back from CircleCI team.

Morteza June 15, 2022 at 1:39 PM

I'm running tests to see the impact of using artifacts (instead of cache) to pass the OCI images to the smoke tests steps.

 

Morteza June 14, 2022 at 7:44 PM

On June 10, we (Ben and I) have reduced the number of days we store Artifacts (down to 20 days), Workspaces (down to 8 days) and Cache (down to 10 days) on the openNMS and openNMS Cloud project. 

 
We started with 7.5 TB of storage per months in current billing period. The expectation is that we will see the following reductions * Artifacts drops from 4.9TB to 2.3TB

  • Workspaces drops from 1.3TB to 0.43TB

  • Cache drops from 1.3TB to 0.86

Morteza June 3, 2022 at 12:54 PM
Edited

Created https://github.com/OpenNMS/opennms/pull/4811 

In this PR (to be merged into Foundation-2019), we are disabling smoke tests and rpm generation in normal builds. 

I did not delete the smoke-test-minimal entry, instead I have commented it out. The reason I have taken this approach is allow for cases when we really need to run a smoke test quickly.

Fixed

Details

Assignee

Reporter

Story Points

Sprint

Fix versions

Priority

PagerDuty

Created March 29, 2022 at 11:18 PM
Updated August 8, 2022 at 5:35 PM
Resolved August 8, 2022 at 5:35 PM