Profile Performance of TSS

Description

We want to get a feel for the performance of the TSS.

Therefor we run a series of tests.

Counting of writes

  • TSS + Cortex: check writes

  • TSS + InMemory: check writes

Looking into "hot" methods
in the TSS to find problematic spots

  • TSS + Cortex

  • TSS + InMemory

Acceptance / Success Criteria

None

Attachments

13
  • 13 Jul 2020, 03:56 PM
  • 13 Jul 2020, 03:53 PM
  • 13 Jul 2020, 03:48 PM
  • 13 Jul 2020, 03:47 PM
  • 08 Jul 2020, 08:48 PM
  • 08 Jul 2020, 07:36 PM
  • 08 Jul 2020, 07:32 PM
  • 08 Jul 2020, 07:12 PM
  • 08 Jul 2020, 07:12 PM
  • 07 Jul 2020, 10:30 PM
  • 07 Jul 2020, 10:27 PM
  • 07 Jul 2020, 10:02 PM

Lucidchart Diagrams

Activity

Patrick Schweizer July 15, 2020 at 1:45 PM

thumbs up I think we are good slightly smiling face let's close this issue.

Jesse White July 13, 2020 at 4:34 PM
Edited

If those two number match and the collection set generation (the stress command) takes account for the bulk of the processing time then we're in a good place. I suspect the generation is being limited by some other factor like memory/GC.

Based on the latest results from the profile above we've show that the performance of the TSS integration layer is sufficient and the rest is really up to the plugin implementation.

I'm good to resolve this with the results we have unless you think something warrants further research. 

Patrick Schweizer July 13, 2020 at 4:02 PM
Edited

I think they more or less do. Here is a comparison between the two:


But the events generation rate by the stress command doesn't seem to be ~40k but ~11k for numeric attributes and ~4,5k for string attributes.

It promised ~41k:

My CPU seems to hover around 50% for all cores:

it almost  looks like the cpu usage is caped at 50%.

Looking at the profiler it shows me most time is spent generating the events by the stress command, logging and karaf:

=> Maybe my local system is just not performant enough to produce the 41k?

 

Jesse White July 9, 2020 at 2:32 PM
Edited

For the case of the in-memory plugin:

I would expect the number of samples/sec reported by the plugin to match the number of "numeric attributes per second" reported by the stress tool.

We need to figure out why these don't match and understand where the time is being spent.

Patrick Schweizer July 8, 2020 at 8:58 PM

, I finished the investigation.
Probably it's best to go together over the results?
Let me know.

Fixed

Details

Assignee

Reporter

Sprint

Priority

PagerDuty

Created July 7, 2020 at 9:34 PM
Updated July 15, 2020 at 1:45 PM
Resolved July 15, 2020 at 1:45 PM

Flag notifications