Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert #2795: Rewrite cucumber test caching, Tests Failing At Random #2934

Closed
wants to merge 1 commit into from

Conversation

daniel-j-h
Copy link
Member

The Cucumber caching PR @springmeyer merged into master yesterday (ref. #2795) does not work. Invoking npm test multiple times (so we hit the cache) lets tests fail at random and only sometimes.

Here is an example (specific tests are not important, write after end error is):

https://gist.github.com/daniel-j-h/d73b4fcea574e61f1815505f1aae44be

Reverting this commit to get a working master again.

@@ -620,7 +620,7 @@ Feature: Turn Lane Guidance
| a,d | hwy,hwy | depart,arrive | , |
| a,e | hwy,ramp,ramp | depart,off ramp slight right,arrive | ,straight:false straight:false straight;slight right:true slight right:true, |

@todo
@bug @todo
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

seems like a few additional bug tags got back in here?

@@ -422,7 +422,7 @@ Feature: Turn Lane Guidance
| waypoints | route | turns | lanes |
| a,e | main,main,main,main | depart,use lane straight,continue right,arrive | ,left:false straight:false straight:false straight:false straight:true straight:true right:false,straight:false straight:false right:false right:true right:true, |

@anticipate @todo @2661
@anticipate @todo @bug @2661
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also additional bug tag

Feature: Known bugs

Background:
Given the profile "testbot"
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is that feature designated to do something? Right now it seems completely empty. If we want to keep it, we should move known bugs here

@@ -173,7 +173,7 @@ Feature: Via points
| c,d,a | abc,bd,bd,bd,abc,abc |

# See issue #2349
@todo
@bug @todo
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

additional label

@springmeyer
Copy link
Contributor

https://gist.github.com/daniel-j-h/d73b4fcea574e61f1815505f1aae44be

First step I tried replicating this on OS X, but can't. Next I will try linux...

@springmeyer
Copy link
Contributor

I'm still unable to replicate on my linux machine. Sounds like @oxidase has been able to replicate on linux only with a release build and 500ms timeout (refs #2936). So, I think this revert should be paused and the focus instead put on testing the fix at #2936. (/cc @daniel-j-h can you test?)

@MoKob
Copy link

MoKob commented Sep 21, 2016

We are going with #2936

@MoKob MoKob closed this Sep 21, 2016
@MoKob MoKob deleted the revert-cucumber-caching-rework branch September 21, 2016 08:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants