k6, a library that wants to break your applications

K6 is an open source tool created by Grafana Labs that allows you to easily execute performance tests written in Javascript.

Installed with apt, dnf, brew, choco or Docker, k6 is available for every type of system or configuration.

My first test

The first step consists of creating a Javascript file, for example `my-first-test.js`. This will contain a function querying the HTTP service you want to test. For example : 

export default function () {
http.get('https://test.k6.io');
sleep(1);
}

This test can be executed using this command: k6 run my-first-test.js. it generates a report in your terminal with some default metrics.

    Example:

        scenarios: (100.00%) 1 scenario, 10 max VUs, 1m0s max duration (incl. graceful stop):

        ✓ status is 200

        checks.........................: 100.00% ✓ 3582       ✗ 0   

data_received..................: 66 MB   2.2 MB/s

        data_sent......................: 397 kB  13 kB/s

        http_req_blocked...............: avg=491.43µs min=0s      med=1µs     max=183.16ms p(90)=1µs     p(95)=2µs     

        http_req_connecting............: avg=136.04µs min=0s      med=0s      max=59.43ms  p(90)=0s      p(95)=0s      

        http_req_duration..............: avg=83.16ms  min=48.73ms med=78.29ms max=446.77ms p(90)=99.27ms p(95)=113.63ms

        { expected_response:true }...: avg=83.16ms  min=48.73ms med=78.29ms max=446.77ms p(90)=99.27ms p(95)=113.63ms

        http_req_failed................: 0.00%   ✓ 0          ✗ 3582

        http_req_receiving.............: avg=5.36ms   min=49µs    med=2.23ms  max=132.79ms p(90)=11.24ms p(95)=14.68ms 

        http_req_sending...............: avg=48.89µs  min=7µs     med=33µs    max=15.64ms  p(90)=55µs    p(95)=67µs    

        http_req_tls_handshaking.......: avg=348.65µs min=0s      med=0s      max=132.02ms p(90)=0s      p(95)=0s      

        http_req_waiting...............: avg=77.74ms  min=47.28ms med=73.64ms max=423.53ms p(90)=93.11ms p(95)=100.03ms

        http_reqs......................: 3582    119.142311/s

        iteration_duration.............: avg=83.83ms  min=48.97ms med=78.5ms  max=446.93ms p(90)=99.38ms p(95)=113.87ms

    iterations.....................: 3582    119.142311/s

        vus............................: 10      min=10       max=10

        vus_max........................: 10      min=10       max=10

    

Options

Of course, this first test doesn’t look like a performance test. The next step is to add a simulation of users. This can be done by setting the number of Virtual Users, using the “vus” option. You can affect a number of vus in the command line (ex : –vus 10) or directly in your js file:

export const options = {
vus: 10,
}

Different options exist, you can find the list on this page: https://k6.io/docs/using-k6/k6-options/reference/

In my quick experiment, I only used `vus` and `duration` to define how long  the test should be running.

Interpret results

Interpreting performance test results is not an easy task. Fortunately, this comes with observability tools, like Prometheus and Grafana that provides insights and graphics on CPU usage, errors rate, endpoint response times, etc.

K6, with its results, gives information about the response time and the percentage of errors.

This gives us a trend about the “temperature” of the healthy API.  

GitLab Integration 

I discovered by reading the documentation that GitLab integrates load performance testing. 

Based on a CI/CD template, GitLab displays on merge requests the comparison of performance tests run on the two branches of the merge request.

I haven’t tested  this feature but I think it would be very interesting to use it with the review app.

⚠️ This feature is deprecated and will be removed in the release 17.0 (cf https://docs.gitlab.com/ee/update/deprecations.html#load-performance-testing-is-deprecated). Thanks Niklas for this information.

An simple and easy integration

No need to be an expert on performance tests, k6 allows you to create first performance tests on APIs in Javascript, execute them on your computer or with the CI/CD and give you statistics about the performance of your API. 

include:

  template: Verify/Load-Performance-Testing.gitlab-ci.yml

load_performance:

  variables:

    K6_TEST_FILE: <PATH TO K6 TEST FILE IN PROJECT>

    K6_OPTIONS: '--duration 30s'

If you want get a great demo of this tool, look like this video: https://everyonecancontribute.com/post/2021-11-23-cafe-45-k6-load-performance-testing/ .


Auteur/Autrice

Laisser un commentaire

Ce site utilise Akismet pour réduire les indésirables. En savoir plus sur comment les données de vos commentaires sont utilisées.

%d blogueurs aiment cette page :