User Tools

Site Tools


uls:testsuite:version_180:aggregations

This is an old revision of the document!


Compressions & Aggregations

Compressions and aggregations and are defined on continuously generated values.


Manually Defined Aggregations

(Setting daily aggregations for domain “Woodlark”).

(A) Specifications

Connect as “SystematicGuy” to ULS and go to

  • administration → compression → set compression → Woodlark → testsrv21 → 200 Continuous Hourly Values → 220 Float Values

“SystematicGuy” has sufficient rights only for domain “Woodlark”, although he may drill down also in domain “ULS”, but cannot define any compressions.

  • activate some checkboxes of the daily block and click

It should look like:

Click on changes of the compression setting to verify that the initial change has been logged.

Click on of the compression setting to view the same result.

Test Description Result Notes
AGGR 0100 manually defined aggregations: specifications successfully defined passed <remark>

Any compression/aggregation action will be executed in the following night.

As user “SystematicGuy”

  • go to main menu → aggregated values → since last week → Woodlark → testsrv21 → 200 Continuous Hourly Values → 220 Float Values
  • verify a list of aggregated values, one row for each day

It should look like:


Domain-Based Aggregations

(Setting hourly and daily aggregations for domain “ULS”).

Connect as “AmieAction” to ULS and go to administration → compression → set auto-compression and chose domain “ULS” (AmieAction has sufficient rights only for domain “ULS”).

  • set section to “200 Continuous Hourly Values”
  • activate all checkboxes of “hourly” and “special” (lowest line) and click
  • continue with
  • to export the definitions to a new browser tab
  • copy the definition and paste it into the import textbox of previous browser tab
  • copy the “hourly” entry to the “daily” entry

It should look like:

create auto-compression for ULS
server=
section=200 Continuous Hourly Values
teststep=
detail=
unit=
hourly=last,avg,sum,dev,min,max,max-min,last-first,count,grad,first,accel,differ,firstsize,last/avg,lastsize
daily=last,avg,sum,dev,min,max,max-min,last-first,count,grad,first,accel,differ,firstsize,last/avg,lastsize
weekly=
monthly=
special=diffof,size,firstline,lastline
access=all

Click to save that. The new entry is added, delete the entry created manually in the first step.

Click on changes of the auto-compression setting to verify that the initial change has been logged.

Click on of the auto-compression setting to verify that all changes have been logged, especially the deleted one.

Any compression/aggregation action will be executed in the following night.


Propagation of Aggregation Rules

Verify, that the above rules are propagated correctly. Check:

  • administration → compression → set compression → ULS → testsrv11 → 200 Continuous Hourly Values → 210 Integer Values

It should look like

Check as user “TheSpyder” that the hourly and daily aggregations are propagated only to details in domain “ULS”.

  • Go to administration → compression → set compression → Woodlark
  • drill down to all details of all sources (servers)
  • verify that no compression definitions are applied, except those above Manually Defined Aggregations for Woodlark → testsrv21 → 200 Continuous Hourly Values → 220 Float Values

Make a report of that:

  • go to main menu → today → auto details selection
  • define a report to show all effective compressions
period today
display compression

:FIXME: 2014-02-13: that does currently not work


Group-Based Aggregations

(Setting weekly and monthly aggregations for all domains (“ULS”, “Woodlark”)).

Connect as “TheSpyder” to ULS and go to administration → compression → group autocompression → AllRounder (that group has full rights for domain “ULS” and “Woodlark”).

  • set section to “*Weekly*”
  • activate all checkboxes of “weekly” (the third block) and click
  • activate checkbox “active [x]” and click

Verify, that the above rules are propagated correctly to all details in all teststeps in both domains:

  • administration → compression → set compression → ULS → testsrv11 → 400 Continuous Weekly Values
  • administration → compression → set compression → ULS → testsrv12 → 400 Continuous Weekly Values
  • administration → compression → set compression → Woodlark → testsrv21 → 400 Continuous Weekly Values
  • administration → compression → set compression → Woodlark → testsrv22 → 400 Continuous Weekly Values

Verify, that the above rules are NOT propagated to any detail in any teststep of both domains:

  • administration → compression → set compression → ULS → testsrv11 → 500 Continuous Monthly Values
  • administration → compression → set compression → ULS → testsrv12 → 300 Continuous Daily Values
  • administration → compression → set compression → Woodlark → testsrv21 → 500 Continuous Monthly Values
  • administration → compression → set compression → Woodlark → testsrv22 → 300 Continuous Daily Values

Go to administration → compression → group autocompression → AllRounder, click on and enter:

create auto-compression for AllRounder
server=
section=500*
teststep=
detail=
unit=
hourly=
daily=
weekly=
monthly=last,avg,sum,dev,min,max,max-min,last-first,count,grad,first,accel,differ,firstsize,last/avg,lastsize
special=diffof,size,firstline,lastline
access=all

Click to save that.

Verify that the checkboxes for the monthly and special blocks are activated.

Click on changes of the auto-compression setting to verify that the initial change has been logged.

Verify, that the above rules are propagated correctly to both domains. Check:

  • administration → compression → set compression → ULS → testsrv11 → 400 Continuous Weekly Values
    • 420 Float Values (only the weekly block)
    • 430 Text Expressions (weekly block)
    • 440 Files (weekly block with 8 elements)
  • administration → compression → set compression → ULS → testsrv12 → 500 Continuous Monthly Values
    • 520 Float Values (only the monthly block)
    • 530 Text Expressions (monthly block and special block)
    • 540 Files (monthly block with 8 elements and the special block)
  • administration → compression → set compression → Woodlark → testsrv21 → 400 Continuous Weekly Values
    • 410 Integer Values (only the weekly block)
    • 420 Float Values (only the weekly block)
    • 440 Files (weekly block with 8 elements)
  • administration → compression → set compression → Woodlark → testsrv22 → 500 Continuous Monthly Values
    • 510 Integer Values (only the monthly block)
    • 520 Float Values (only the monthly block)
    • 540 Files (monthly block with 8 elements and the special block)

Verify in the following week and following month, that the aggregations work.

:TODO: report


Examination of Compressed and Aggregated Values

Check a subset of all compressed values. The “continuous_values” script must have at least run for more than one day.

Login as “SystematicGuy” and go to main menu → compressed values → yesterday.

Go to main menu → compressed values → yesterday.

Go to ULS → testsrv12 → 200 Continuous Hourly Values → 210 Integer Values, click on and chose

:TODO:


uls/testsuite/version_180/aggregations.1396603148.txt.gz · Last modified: 2014-04-04 11:19 by uls