[SPARK-7017][Build][Project Infra]: Refactor dev/run-tests into Python#5694

Closed

brennonyork wants to merge 57 commits intoapache:masterfrom brennonyork:SPARK-7017

+546-224

Commits on Apr 24, 2015

refactored run-tests into python
Brennon York
committed
uncomment the scala tests :)
Brennon York
committed

Commits on Apr 26, 2015

updated with pep8 rules, fixed minor bugs, added run-tests file in bash to call the run-tests.py script
Brennon York
committed

Commits on Apr 27, 2015

upcased global variables, changes various calling methods from check_output to check_call
Brennon York
committed
added namedtuple for java version to add readability
Brennon York
committed
minor doc string change for java version with namedtuple update
Brennon York
committed
removed unnecessary wait()
Brennon York
committed
removed another wait() call
Brennon York
committed
attempt at better python output when called from bash
Brennon York
committed

Commits on Apr 28, 2015

comment out import to see if build fails and returns properly
Brennon York
committed
removed license file for SparkContext
Brennon York
committed
reverted license, changed test in shuffle to fail
Brennon York
committed

Commits on Apr 29, 2015

updated to return the proper env variable for return codes
Brennon York
committed
fixed typo and added default return is no error block was found in the environment
Brennon York
committed
changed test back and commented out import to break compile
Brennon York
committed
removed the import error and added license error, fixed the way run-tests and run-tests.py report their error codes
Brennon York
committed
reverted rat license issue for sparkconf
Brennon York
committed
Merge remote-tracking branch 'upstream/master' into SPARK-7017
Brennon York
committed
comment out import to fail build test
Brennon York
committed
added space from commented import to now test build breaking
Brennon York
committed
revert build break, add mima break
Brennon York
committed

Commits on Apr 30, 2015

reverted mima exclude issue, added pyspark test failure
Brennon York
committed
reverted pyspark test failure
Brennon York
committed
updated to make sparkR test fail
Brennon York
committed

Commits on May 1, 2015

reverted the sparkR test
Brennon York
committed

Commits on May 11, 2015

fixed merge conflicts
Brennon York
committed
removed building hive-0.12.0 per SPARK-6908
Brennon York
committed

Commits on May 19, 2015

incorporated merge conflicts with SPARK-7249
Brennon York
committed
python to python2 and removed newline
Brennon York
committed

Commits on May 21, 2015

exec python rather than running python and exiting with return code
Brennon York
committed

Commits on May 26, 2015

fixed merge conflicts, ensured that for regular builds both core and sql tests always run
Brennon York
committed

Commits on Jun 5, 2015

updated to refactor and remove various small bugs, removed pep8 complaints
Brennon York
committed
made error codes a global
Brennon York
committed

Commits on Jun 9, 2015

finalizing revisions to modular tests
Brennon York
committed

Commits on Jun 10, 2015

testing targte branch dump on jenkins
Brennon York
committed
fixed merge conflicts
Brennon York
committed
reverted SPARK_HOME from start of command
Brennon York
committed
fixed sbt_test_goals reference error
Brennon York
committed
added a change to streaming test to check if it only runs streaming tests
Brennon York
committed
updated python tests to remove unused variable
Brennon York
committed
prepend rather than append onto PATH
Brennon York
committed
changed example to comply with pep3113 supporting python3
Brennon York
committed
fixed the tuple () wraps around example lambda
Brennon York
committed
reverting streaming context
Brennon York
committed

Commits on Jun 14, 2015

minor name changes, bug fixes
Brennon York
committed

Commits on Jun 15, 2015

added documentation builds as a top level test component, altered high level project changes to properly execute core tests only when necessary, changed variable names for simplicity
Brennon York
committed
minor doc addition to print the changed modules
Brennon York
committed
fixed minor set bug
Brennon York
committed
unpack set operations with splat (*)
Brennon York
committed

Commits on Jun 16, 2015

fixed path joining issues, ensured docs actually build on doc changes
Brennon York
committed
fixed pep8 whitespace errors
Brennon York
committed
add check if jekyll isn't installed on the path
Brennon York
committed
added check for jekyll install
Brennon York
committed
removed the test check for documentation changes until jenkins can get updated
Brennon York
committed
reverted doc test change
Brennon York
committed
removed necessary passed in variable
Brennon York
committed
updated finding java binary if JAVA_HOME not set
Brennon York
committed