User Tools

Site Tools


uls:testsuite:version_180:aggregations

This is an old revision of the document!


Compressions & Aggregations

Compressions and aggregations and are defined on continuously generated values.


Manually Defined Aggregations

(Setting daily aggregations for domain “Woodlark”).

Connect as “SystematicGuy” to ULS and go to administration → compression → set compression → Woodlark → testsrv21 → 200 Continuous Hourly Values → 220 Float Values (“SystematicGuy” has sufficient rights only for domain “Woodlark”, although he may drill down also for domain “ULS”, but cannot define any compressions).

  • activate some checkboxes of the daily block and click

It should look like:

Click on changes of the compression setting to verify that the initial change has been logged.

Click on of the compression setting to view the same result.

Any compression/aggregation action will be executed in the following night.

As user “SystematicGuy”

  • go to main menu → compressed values → since last week → Woodlark → testsrv21 → 200 Continuous Hourly Values → 220 Float Values
  • verify a list of compressed values, one row for each day

It should look like:


Domain-Based Aggregations

(Setting hourly and daily aggregations for domain “ULS”).

Connect as “AmieAction” to ULS and go to administration → compression → set auto-compression and chose domain “ULS” (AmieAction has sufficient rights only for domain “ULS”).

  • set section to “200 Continuous Hourly Values”
  • activate all checkboxes of “hourly” and “special” (lowest line) and click
  • continue with
  • to export the definitions to a new browser tab
  • copy the definition and paste it into the import textbox of previous browser tab
  • copy the “hourly” entry to the “daily” entry

It should look like:

create auto-compression for ULS
server=
section=200 Continuous Hourly Values
teststep=
detail=
unit=
hourly=last,avg,sum,dev,min,max,max-min,last-first,count,grad,first,accel,differ,firstsize,last/avg,lastsize
daily=last,avg,sum,dev,min,max,max-min,last-first,count,grad,first,accel,differ,firstsize,last/avg,lastsize
weekly=
monthly=
special=diffof,size,firstline,lastline
access=all

Click to save that. The new entry is added, delete the entry created manually in the first step.

Click on changes of the auto-compression setting to verify that the initial change has been logged.

Click on of the auto-compression setting to verify that all changes have been logged, especially the deleted one.

Any compression/aggregation action will be executed in the following night.


Propagation of Aggregation Rules

Verify, that the above rules are propagated correctly. Check:

  • administration → compression → set compression → ULS → testsrv11 → 200 Continuous Hourly Values → 210 Integer Values

It should look like

Check as user “TheSpyder” that the hourly and daily aggregations are propagated only to details in domain “ULS”.

  • Go to administration → compression → set compression → Woodlark
  • drill down to all details of all sources (servers)
  • verify that no compression definitions are applied, except those above Manually Defined Aggregations for Woodlark → testsrv21 → 200 Continuous Hourly Values → 220 Float Values

Make a report of that:

  • go to main menu → today → auto details selection
  • define a report to show all effective compressions
period today
display compression

:FIXME: 2014-02-13: that does currently not work


Group-Based Aggregations

(Setting weekly and monthly aggregations for all domains (“ULS”, “Woodlark”)).

Connect as “TheSpyder” to ULS and go to administration → compression → group autocompression → AllRounder (that group has full rights for domain “ULS” and “Woodlark”).

  • set section to “*Weekly*”
  • activate all checkboxes of “weekly” (the third block) and click
  • activate checkbox “active [x]” and click

Verify, that the above rules are propagated correctly to all details in all teststeps in both domains:

  • administration → compression → set compression → ULS → testsrv11 → 400 Continuous Weekly Values
  • administration → compression → set compression → ULS → testsrv12 → 400 Continuous Weekly Values
  • administration → compression → set compression → Woodlark → testsrv21 → 400 Continuous Weekly Values
  • administration → compression → set compression → Woodlark → testsrv22 → 400 Continuous Weekly Values

Verify, that the above rules are NOT propagated to any detail in any teststep of both domains:

  • administration → compression → set compression → ULS → testsrv11 → 500 Continuous Monthly Values
  • administration → compression → set compression → ULS → testsrv12 → 300 Continuous Daily Values
  • administration → compression → set compression → Woodlark → testsrv21 → 500 Continuous Monthly Values
  • administration → compression → set compression → Woodlark → testsrv22 → 300 Continuous Daily Values

Go to administration → compression → group autocompression → AllRounder, click on and enter:

create auto-compression for AllRounder
server=
section=500*
teststep=
detail=
unit=
hourly=
daily=
weekly=
monthly=last,avg,sum,dev,min,max,max-min,last-first,count,grad,first,accel,differ,firstsize,last/avg,lastsize
special=diffof,size,firstline,lastline
access=all

Click to save that.

Verify that the checkboxes for the monthly and special blocks are activated.

Click on changes of the auto-compression setting to verify that the initial change has been logged.

Verify, that the above rules are propagated correctly to both domains. Check:

  • administration → compression → set compression → ULS → testsrv11 → 400 Continuous Weekly Values
    • 420 Float Values (only the weekly block)
    • 430 Text Expressions (weekly block)
    • 440 Files (weekly block with 8 elements)
  • administration → compression → set compression → ULS → testsrv12 → 500 Continuous Monthly Values
    • 520 Float Values (only the monthly block)
    • 530 Text Expressions (monthly block and special block)
    • 540 Files (monthly block with 8 elements and the special block)
  • administration → compression → set compression → Woodlark → testsrv21 → 400 Continuous Weekly Values
    • 410 Integer Values (only the weekly block)
    • 420 Float Values (only the weekly block)
    • 440 Files (weekly block with 8 elements)
  • administration → compression → set compression → Woodlark → testsrv22 → 500 Continuous Monthly Values
    • 510 Integer Values (only the monthly block)
    • 520 Float Values (only the monthly block)
    • 540 Files (monthly block with 8 elements and the special block)

Verify in the following week and following month, that the aggregations work.

:TODO: report


Examination of Compressed and Aggregated Values

Check a subset of all compressed values. The “continuous_values” script must have at least run for more than one day.

Login as “SystematicGuy” and go to main menu → compressed values → yesterday.

Go to main menu → compressed values → yesterday.

Go to ULS → testsrv12 → 200 Continuous Hourly Values → 210 Integer Values, click on and chose

:TODO:


uls/testsuite/version_180/aggregations.1392710382.txt.gz · Last modified: 2014-02-18 08:59 by uls