Skip to content

Commit

Permalink
Add E2E readme file
Browse files Browse the repository at this point in the history
  • Loading branch information
Stefan Buck committed Jul 4, 2018
1 parent c700f67 commit 206e05a
Showing 1 changed file with 70 additions and 0 deletions.
70 changes: 70 additions & 0 deletions e2e/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,70 @@
# OctoLinker E2E Tests

## What is E2E Testing?

E2E stand for End to End testing and the following lines explains it the best which I have copied from [Protractor](https://docs.angularjs.org/guide/e2e-testing);

> As applications grow in size and complexity, it becomes unrealistic to rely on manual testing to verify the correctness of new features, catch bugs and notice regressions. Unit tests are the first line of defense for catching bugs, but sometimes issues come up with integration between components which can't be captured in a unit test. End-to-end tests are made to find these problems.
### How we do E2E tests

We're using [Puppeteer](https://github.com/GoogleChrome/puppeteer) which allows us to spin up a Chrome instance which then loads the OctoLinker extension. Once Chrome has started we can navigate to any website which is github.com in our case. In this directory we also have a folder called [fixtures](https://github.com/OctoLinker/OctoLinker/tree/master/e2e/fixtures) which contains all our dummy files which we use for testing.

If you open one of those files, you will see a special annotation which we use to specify that the next line should resolve to the given target.

```js
// When the target is an external url
// @OctoLinkerResolve(https://nodejs.org/api/fs.html)
require('fs')

// When the target is a relative file
// @OctoLinkerResolve(<root>/path/to/foo.js)
require('./foo.js')
```

The annotation is language agnostic so you can also use it for ruby or any other language.

```ruby
# @OctoLinkerResolve(https://rubygems.org/gems/rake)
require 'rake'
```

It's also working within json files.

```js
{
"dependencies": {
"//": "@OctoLinkerResolve(https://github.com/lodash/lodash)",
"lodash": "^1.2.3"
}
}
```

## How do we know

Before we invoke [jest](https://github.com/facebook/jest), we scan the fixtures folder for those annotation and write a file named `fixtures.json` on the disk. This json file then gets loaded by our actual test file (https://github.com/OctoLinker/OctoLinker/blob/master/e2e/automated.test.js) to scaffold those tests on-the-fly.


```js
[
{
"url": "https://github.com/OctoLinker/OctoLinker/blob/master/e2e/fixtures/javascript/nodejs/gentle-resonance-3436.js",
"content": "require('./proud-tooth-7361');",
"targetUrl": "/javascript/nodejs/proud-tooth-7361.js",
"lineNumber": 2
},
{
"url": "https://github.com/OctoLinker/OctoLinker/blob/master/e2e/fixtures/javascript/npm/package.json",
"content": "\"underscore\": \"1.2.3\"",
"targetUrl": "https://github.com/jashkenas/underscore",
"lineNumber": 8
},
...
]
```

## Contribution

We made this process super simple. Just create files within `e2e/fixtures` and make sure the annotation target is set correctly, that's all. If you have a minute or two we would really appreciate a PullReqeust from you to increase our coverage.


0 comments on commit 206e05a

Please sign in to comment.