August 16, 2023 API Testing

 Date

Aug 16, 2023

 Participants

  • @Dominika Bieńkowska (Deactivated)

  • @Damian Borowiecki (Deactivated)

  • @Paweł Gesek

  • @Satyajit Suri

  • @Meelis Zujev (Deactivated)

  • @Taylor Downs

  • @PSRAMKUMAR

  • @Margus Mägi

  • @Steve Conrad

 Goals

  • Go through and align on Testing Harness documents and presentation for Egypt Deep Dive

 Discussion topics

Item

Who

Discussion

Item

Who

Discussion

One pager review

@Damian Borowiecki (Deactivated)

Presentation overview

@Damian Borowiecki (Deactivated)

  • https://docs.google.com/presentation/d/1uTDPabCW7pnh2t14ulgvblk0BmyR8qFH/edit?usp=sharing&ouid=118375980738739643283&rtpof=true&sd=true

  • Important part of the test harness is deployment(can the software run?) and communication (can it get HTTP requests?).

  • We can showcase openIMIS or Camunda during the presentation to show real results (not mocked ones). We can only present that the configuration made for one BB can be reused for other BB configuration.

  • Improvements to the testing app before Deep Dive:

    • Filter branches to only show main branch results (currently there are multiple results from softwares) .

    • Performance of the testing app, data is loading too slow.

  • We should avoid switching environments during presentation and just describe screenshots from the app instead of switching from slides and testing app.

  • We should explain why the technology used in the testing harness is an effective way for this solution.

  • Terminology - we should explain all the terminology we’re using like example implementation, softwares, building block, execution, etc… to make sure it’s well described. During the first technical session there will be an introduction to the terminology.

  • Add one slide with terminology explained to our testing harness presentation .

  • Text is too small and there are too many white spaces (applies to all slides).

  • Add summary of the tests and APIs that are already implemented in the GovStack (summary by BBs).

  • We should add a slide to describe “Why the solution is unique?”, “Why to choose this solution?” and “How the community collaborate?”.

 

@Taylor Downs notes:

Taylor, please add your notes here . OK!

  1. For the presentation, @Dominika Bieńkowska, (cc @Satyajit Suri) a screen grab with actual candidate test results. Some pass, some fail. I think this is good example. (see below)

  2. @Damian Borowiecki, alignment is messed up in the list view on slide 4

  3. More slide 4 notes: the most fundamental requirements to be a govstack BB are: deployability (how can we set it up?) and communication via HTTP (how can we hit a REST API?).

  4. Slide 8 - attempt at the simplest explanation of the flow

    1. when a change is made to a specification

    2. or when a candidate is added or updated (new version)

    3. the test harness iterates through every single candidate and test suite and

    4. deploys the app, configures it for a given test suite, and runs the tests against it

    5. then it sends the results for all suites and candidates to testing.govstack.global

  5. Slide 10 - put boxes around each. title the boxes: “bb repo”, “candidate”, “test suite”

  6. Slide 13 - add why this matters. external stakeholders look at testing.govstack.global, a dev trying to make code changes to the spec, the tests, or the candidate config looks at github/circleCi

 

Discussion - what is missing, what should be changed or removed

All participants

  • Future plans:

    • We should add a note about compliance form and extending the testing app.

    • Compliance aspect might be very important for the audience.

    •  

  •  

Potential questions we can get.

All participants

AOB

 

  •  

 Action items

Action Items

Responsible party

Date

Action Items

Responsible party

Date

 

 

 

 

 

 

 

Meeting recording