项目作者: ply-ct

项目描述 :
API Automated Testing
高级语言: TypeScript
项目地址: git://github.com/ply-ct/ply.git
创建时间: 2018-04-14T19:49:05Z
项目社区:https://github.com/ply-ct/ply

开源协议:MIT License

下载



ply-logo












API Automated Testing

Installation

  1. npm install @ply-ct/ply --save-dev

Or, to run anywhere:

  1. npm install -g @ply-ct/ply

Usage

Ply API testing starts with a YAML file containing requests. Here’s a GET request to retrieve
topics for the ply-demo repository using
GitHub API v3:

  1. repositoryTopics:
  2. url: 'https://api.github.com/repos/ply-ct/ply-demo/topics'
  3. method: GET
  4. headers:
  5. Accept: application/vnd.github.mercy-preview+json

Submit a request

Suppose you save this in a file named “github.ply.yaml”. Then you can submit the
repositoryTopics request from a command line by typing:

  1. ply -s github.ply.yaml

The -s argument tells Ply not to verify the response (-s is short for --submit,
meaning submit an ad hoc request and don’t bother with verification).

Verify response

If you run without -s you’ll get an error saying, “Expected result file not found”. Ply verification
works by comparing expected vs actual. So a complete test requires an expected result file. Run again
with --create, and the expected result file will be created from the actual response.

  1. ply --create github.ply.yaml

Output looks like this:

  1. Request 'repositoryTopics' submitted at 4/11/2022, 11:19:46:292
  2. Creating expected result: ./results/expected/github.yaml
  3. Request 'repositoryTopics' PASSED in 332 ms
  4. Overall Results: {"Passed":1,"Failed":0,"Errored":0,"Pending":0,"Submitted":0}
  5. Overall Time: 373 ms

During execution Ply submits the request and writes actual result file “./results/actual/github.yaml”
based on the response. Because of --create, Ply then copies the actual result over expected result file “./results/expected/github.yaml”
before comparing. This test naturally passes since the results are identical.

Expected results

Auto-creating an expected result provides a good starting point. But if you run the request again (without creating), it’ll fail:

  1. ply github.ply.yaml
  2. Request 'repositoryTopics' submitted at 4/11/2022, 11:20:44:478
  3. Request 'repositoryTopics' FAILED in 372 ms: Results differ from line 24
  4. 24
  5. - x-github-request-id: E8C2:3201:51B1B:D9917:62546332
  6. + x-github-request-id: E8C3:7857:386D8:7DDEE:6254636C
  7. ===
  8. 26
  9. - x-ratelimit-remaining: '56'
  10. + x-ratelimit-remaining: '55'
  11. ===
  12. 29
  13. - x-ratelimit-used: '4'
  14. + x-ratelimit-used: '5'
  15. ===

But looking at “./results/expected/github.yaml”,
you’ll notice that it includes many response headers that are not of interest for testing purposes. Here’s a
cleaned-up version of similar expected results from ply-demo:

  1. repositoryTopics:
  2. request:
  3. url: https://api.github.com/repos/${github.organization}/${github.repository}/topics
  4. method: GET
  5. headers:
  6. Accept: application/vnd.github.mercy-preview+json
  7. response:
  8. status:
  9. code: 200
  10. message: OK
  11. headers:
  12. content-type: application/json; charset=utf-8
  13. body: |-
  14. {
  15. "names": [
  16. "rest-api",
  17. "testing",
  18. "ply",
  19. "example-project",
  20. "graphql",
  21. "typescript",
  22. "workflow"
  23. ]
  24. }

The subset of response headers included in expected results YAML are those we care about for comparison.
In this test, body content is our main concern.

Expressions

Something else about this example that may be noticed by sharp-eyed observers: our request URL contains
placeholders like ${github.organization}. Ply supports JavaScript template literal
syntax for substituting dynamic values in both requests and results. Values come from JSON files and/or environment variables,
as described in the docs under Values.

Even more powerfully, your multi-request suites can embed expressions that reference runtime values from previous responses.
For instance, the URL or body of a subsequent request in our github.ply.yaml file could have something like this:

  1. ${@repositoryTopics.response.body.names[0]}

which uses the special @ character to reference the first topic name from above (resolving to ‘rest-api’).
This enables you to string together sequential requests that each depend on response output from preceding ones.
Check out the Results topic for details and examples.

Flows

If you have Visual Studio Code with the Ply extension,
you can graphically chain multiple requests into a workflow. See the Ply flows documentation for details.

Flows can include custom TypeScript steps to perform complex interactions and update runtime values.

Running a flow from the command line is similar to running a request suite:

  1. ply test/flows/movies-api.flow

GraphQL

Body content in request YAML can be any text payload (typically JSON). GraphQL syntax is also supported, as in this
example which queries the GitHub GraphQL API for ply-demo repository topics:

  1. repositoryTopicsQuery:
  2. url: 'https://api.github.com/graphql'
  3. method: POST
  4. headers:
  5. Authorization: Bearer ${githubToken}
  6. Content-Type: application/json
  7. User-Agent: ${github.organization}
  8. body: |-
  9. query {
  10. repository(owner: "${github.organization}", name: "${github.repository}") {
  11. repositoryTopics(first: 10) {
  12. edges {
  13. node {
  14. topic {
  15. name
  16. }
  17. }
  18. }
  19. }
  20. }
  21. }

Documentation

Guide

https://ply-ct.org/ply/topics/requests

CLI

https://ply-ct.org/ply/topics/cli

API

https://ply-ct.org/ply/api

Demo Project

https://github.com/ply-ct/ply-demo

VS Code Extension

https://marketplace.visualstudio.com/items?itemName=ply-ct.vscode-ply