Availabilities/Reliabilities


Availability/Reliability

Availability: Service Availability is the fraction of time a service was in the UP Period during the known interval in a given period.

Reliability: Service Reliability is the ratio of the time interval a service was UP over the time interval it was supposed (scheduled) to be UP in the given period.

From this page you can see the latest values for monthly repoorts for A/R for your infrastructure. A report is actually a configuration file that is used to describe the services you want to check, the metrics you want to use for each service and the grouping of the services.

The report may contain A/R values based on the group you chose in the Configuration Management Database :

  • Sites : List of services that participate in the site
  • Project: A list of services that are used in a project.

Availability/Reliability Table

This is table with the main information. The Availability and Reliability values for the last 4 months.

If you want to learn more about the daily availability or Reliability values of a specific month the only think you can do is to click on a value of Availability or Reliability (like option 1 or 2 in image 1 ).

If you want to learn more about the services or the endpoints of the services you can clink on the name of the group you want (like option 3 in image 1 ) and drill down to other options.

Image 1: Availability/Reliability Table

Daily Availability/Reliability Table

The Daily Availability/Reliability Table display information about:

  • Availability
  • Reliability
  • Unknown: the period (start_time --> end_time) in which a specific service / service endpoint was in an unknown Status. In this table we provide the percentage it was unknown during this day.
  • Downtime: the period (start_time --> end_time) in which a specific service / service endpoint was in scheduled downtime. In this table we provide the percentage it was in scheduled downtime during this day.
Image 1-a: Daily Availability/Reliability Table

Availability/Reliability Charts

A graphical representation of data, and in which the data is represented by bars in a bar chart. This chart compares Availability and Reliability values for the last 4 months for each item.

Image 2: Availability/Reliability Charts

Other Functionalities

All the pages under this section offer the functionality of searching in the results of the existing page.

Image 3: Search

All the pages under this section offer the functionality of copying the data to clipboard or even exporting them to different formats like excel, csv, pdf.

Image 4: Export

Status


Introduction

This is the page where you may see the status for the whole infrastructure while at the same time you can drill down to services, service endpoints and metrics.

    Before we start some definitions about the services, service types and service endpoints.
  • From the ARGO monitoring service perspective, a monitored infrastructure is composed of a group of services.
  • Services are composed of service instances of a specific Service Type, which are called Service Endpoints.
  • A Service Type is a group of metrics that are checking a specific service from the monitoring perspective.
  • Each Service Type can have a defined set of metrics, which are explicit tests that we run in order to assess the status of a Service Endpoint.


Status Page : landing page

Τhe first information you can see is about the groups you have (ex Services) . This page is automatically updated and it displays near real time information about the status of the groups.
Image 1: Landing page
  • Above the timelines there is an arrow that can help you navigate through the days (divvious or next when available).
  • You may drill down to the services page and get more information about the services endpoints and finally about the metrics
Image 2: Metric details

How is the status computed?

  • The ARGO Analytics Engine expects to receive a stream of metric results produced by a monitoring engine.
  • A metric result is the output of a specific test that was run at a specific time against a specific service endpoint.
  • A metric result includes at least:
  • a timestamp showing when the given monitoring probe was executed
  • the name of the service type (e.g. HTTPS Web Server)
  • the name of the hostname on which the service is running (e.g. www.example.com)
  • the name of the metric that was tested (e.g. TCP_CHECK)
  • the status result that was produced by the monitoring probe (e.g. OK)
An example metric result in is shown below:

 {
    "timestamp": "2019-05-02T10:53:38Z",
    "metric": "org.web.check-tcp",
    "service_type": "HTTPS Web Server",
    "hostname": "www.example.com",
    "status": "OK"
}
The ARGO Analytics Engine receives a stream of metric results and creates a set of status timelines for each service endpoint and metric tuple. The engine computes the status of the Service Endpoints based on the results from each defined metric for the Service Type of the Service Endpoints, which have been checked within a time frame that matches the frequency with which the probe is executed.


The main statuses you may see in the timeline are :
  • A OK state that means that the operation of the service endpoint / service / service group is normal
  • A WARNING state is used for situations when service is still functional, but it is in a non-optimal state. This state is most often used in combination with thresholds, e.g. if response time is more than X or certificate lifetime expires in less than X days. This state changes the state of the / service / service group based on the profiles defined.
  • A CRITICAL state is used for situations when service is not functioning properly or at all. This means that the service is not responding correctly to the checks metrics that are executed. This state changes the state of the / service / service group based on the profiles defined.
  • A DOWNTIME state, that means that the service endpoint / service / service group has declared downtime for a period.
Special States:
  • A MISSING state, which is used in order to fill the timelines when a metric isn’t divsent in the consumer data for a period of time
  • An UNKNOWN state, which is used in order fill the timelines when a re-computation exclusion is applied
So for example, let’s assume that the service we are interested in is the website https://www.example.com and that there are two metrics defined for a secure website, the TCP_CHECK and CHECK_CERTIFICATE_VALIDITY. In order for the website to be considered as OK, the results for both the tcp check and the check for the certificate validity must be OK. How the individual results of each metric for a Service Type are combined in order to compute the status of the Service Endpoint, is defined in what we call truth tables. The truth tables can be updated for each infrastructure

Downtimes


Introduction

  • One of the most important features of the registry is the Downtime Calendar, through which users can inform others that a service will stop being active for a certain period of time.
  • A downtime is a period of time for which a service is declared to be inoperable. Downtimes may be scheduled (e.g. for software/hardware upgrades), or unscheduled (e.g. power outages).
  • All the features described in this document are available here : SDC GOCDB
  • All downtimes declared in GOC DB will be reflected into the ARGO system .

Set a downtime period

Adding a downtime period is very easy and simple, just going to the corresponding page and fill in the form fields. GOCDB stores the following information about downtimes (non exhaustive list):
  • The downtime classification (Scheduled or unscheduled)
  • The severity of the downtime
  • The date at which the downtime was added
  • The start and end of the downtime period
  • A description of the downtime
  • The entities affected by the downtime
Scheduled or unscheduled ? Depending on the planning of the intervention, downtimes can be:
  • Scheduled: planned and agreed in advance
  • Unscheduled: planned or unplanned, usually triggered by an unexpected failure or at a short term notice
Please note:
  • All dates have to be entered in UTC.
  • A downtime can be retrospectively added if its start-date is less than 48h in the past (giving a 2 day window to add).
  • downtime classification (scheduled/unscheduled) is determined automatically
The first thing you have to do is to select the "Add Downtime" on the menu on the left. (see image below)
Image 1: Main page - Add downtime
Adding a downtime period is very easy and simple, just going to the corresponding page and fill in the form fields.
Image 2: Add downtime - Fill the fields
  • Severity: When declaring a downtime, you will be presented the choice of a "severity", which can be either WARNING or OUTAGE. Please consider the following definitions:
    • Outage : means the resource is considered as unavailable. Such downtimes will be considered as "IN MAINTENANCE" by monitoring and availability calculation tools.
    • Warning : means the resource is considered available, but the quality of service might be degraded. Such downtimes generate notifications, but are not taken into account by monitoring and availability calculation tools.
  • Description: A description about the downtime.

  • Starts on
    • Day: The day it starts.
    • Time: The exact start time please add a correct timezone
  • Ends on
    • Day: The day it ends.
    • Time: The exact end time please add a correct timezone
  • Select Affected Site: Select the site that is going to be affected.
  • Select Affected Services + Endpoints: Which services will be affected.

Update a downtime

To edit a downtime, simply click the "edit" link on top of the downtime's details page. A downtime can be retrospectively updated if its start-date is less than 48h in the past (giving a 2 day window to modify)

Delete a downtime

To delete a downtime, simply click the delete link on top of the downtime's details page. For integrity reasons, it is only possible to remove downtimes that have not started.

View downtime Calendar

You can also view the scheduled downtimes from the corresponding page.
Image 3: Main page – View Downtime Calendar
Image 4: Downtimes Calendar page – Month view

Dashboard


Introduction

This page is a synoptic view for your monitoring data and a given report (ex. Critical.)
    The main information consists of
  • the description of the topology - structure (project, sites,) and list of the related entries
  • the results of availabilities/reliabilities for the last 30 days
  • The last status check via a donut chart . (more information below)
  • The last status changes.(more information below)
  • The downtimes affecting the the services (more information below)
Image 1: Dashboard

Last status checks

Donut Chart

The doughnut chart shows the last status checks. Pie and doughnut charts are probably the most commonly used charts.

They are divided into segments, the arc of each segment shows the proportional value of each piece of data. Here the segment is the different results of checks

You may see the number of Critical, Missing, Ok, Unknown, and Warning Checks.

>
Image 2: Donut chart

Last statuses Table

From this table you may see the 500 last status changes with the distribution and the details of these changes.

This table has the functionalities of searching and sorting the data in order to find the check you are looking for.

At the bottom of the table pagination is enabled to help you navigate through the results. Βy clicking on the lens icon you can see more information about the status.

Image 3: Last statuses table

Downtimes

From here you may see the downtimes affecting the sites/services. This table has the functionalities of searching and sorting the data in order to find the check you are looking for.

At the bottom of the table pagination is enabled to help you navigate through the results. Βy clicking on the lens icon you can see more information about the downtime.

Image 4: Downtimes table

Custom Report


Introduction

In ARGO UI we provide some predefined Availability, Reliability and Status reports. A Custom Report is a report that you create.

From this page you can create your own custom report for the service you desire.


What is a custom report ?

A Custom report is a report about a service in a selected period of time.

Image 1: Custom report
    In order to create your report you must specify at least:
  • Entity: The entity you want to get the report about
  • Report Type: you can select the type report a) Availability/Reliability - Daily values, b) Availability/Reliability - Monthly values, c) Status
  • Timeline: The period of time for the report like Today, Yesterday, Last 7 Days, Last 30 Days, This Month, Last Month, Last 3 Months, Last 6 Months or a Custom Range.
Image 2: List of predefined timelines
Image 3: Custom Range

Results

According to the type of report you select the results are shown in the following images.

Availability/Reliability - Daily values

In the following image you may see the results for the custom report. It shows the daily values for Availability , Reliability , Unknown and Downtime for the service you selected. You can also export the results in different formats like Excel, CSV, PDF.
Image 4: Availability/Reliability - Daily values

Availability/Reliability - Monthly values

In the following image you may see the results for the custom report. It shows the daily values for Availability , Reliability , Unknown and Downtime for the service you selected. You can also export the results in different formats like Excel, CSV, PDF.
Image 5: Availability/Reliability -Monthly values

Status report

In the following image you may see the results for the custom report. It shows the status values for the service you selected. You can click on the timeline and drill down to the endpoints so as to see the statuses. If you need more information about Status you may also visit the Status documentation page.
Image 6: Status

Global information

The SDC monitoring infrastructure divides Services in 2 main categories:
  • The first category includes the Core Services.
  • The second category includes all the other Services, apart from the Core Services.

Core Services

The first category 'Core Services' consists of 3 Service Groups
  1. The Infrastructure Service Group
  2. The Homepage Service Group
  3. The Downstream Service Group
The above 3 Service Groups, should all be in 'OK' state simultaneously, in order for the Core Services to be considered in 'OK' state.
If one of these 3 Service Groups is in 'CRITICAL' state, then Core Services are likewise considered in 'CRITICAL' state. Every one of these 3 Service Groups includes a number of Service Types, for achieving most accurate monitoring results.

1. The Infrastructure Service Group

The Infrastructure Service Group is responsible for monitoring the EUDAT services and includes 4 Service Types
  • b2access.unity
  • b2safe.irods
  • b2stage.http-api
  • eu.eudat.b2stage.http-api-ingestion

2. The Homepage Service Group

The Homepage Service Group is responsible for monitoring the main SeaDataNet website, where a guest user can browse, search and download dataand includes 1 Service Type
  • eu.seadatanet.org.homepage

3. The Downstream Service Group

The Downstream Service Group is responsible for monitoring the downstream services that enable the users to download the desired data and includes 4 Service Types
  • eu.seadatanet.org.login
  • eu.seadatanet.org.rsm
  • eu.seadatanet.org.search
  • eu.seadatanet.org.search-cdi

Other Services

The second category, that includes all the Services apart from the Core Services, consists of Service Groups that do not relate to each other.
As a result, if one Service Group is in 'CRITICAL' state then the other Service Groups are not affected by this result, as they operate and are monitored independently.
To check the Availability/Reliability of a Service Group, you can generate a Custom Report in the following link https://monitoring.seadatanet.org/sdc/Critical/custom
Along with the Service Group, you can select the time period you want information about it. After the Report is generated, you can export it in Excel, CSV or PDF format.
On the same link you can also check the Status of a Service Group, Service Type or metric, by generating a Custom Report, though in this scenario there is no way of exporting the report.