Skip to content

Skip flaky performance tests in CI#1186

Open
Joao-Dionisio wants to merge 1 commit intomasterfrom
skip-performance-tests
Open

Skip flaky performance tests in CI#1186
Joao-Dionisio wants to merge 1 commit intomasterfrom
skip-performance-tests

Conversation

@Joao-Dionisio
Copy link
Member

No description provided.

@Joao-Dionisio
Copy link
Member Author

What do you think, @DominikKamp @mmghannam @Opt-Mucca ? This comes after #1168 . Would you be okay with ignoring performance tests in the pipelines and relying on local performance runs? I can also add a github action that would write to the PR whenever these tests were failing, and we could decide if it was relevant.

@DominikKamp
Copy link
Contributor

I do not really know what is the point of these one-sided performance tests, but if they matter, increasing the threshold factor to 1.5 might be better than just dropping them completely.

@Opt-Mucca
Copy link
Collaborator

I don't think these pipelines are intended to have performance tests in them, so I don't see a problem with disabling them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants