MORPH
SIGN IN SIGN UP
reasonml / reason UNCLAIMED

Simple, fast & type safe code that leverages the JavaScript & OCaml ecosystems

0 0 1 OCaml
Normal View History Raw
formatTest: set undefined variables and let tests continue on fail `set -u` now defines all variables so that undefined variables will trigger a test script failure. `set -e` is disabled before the tests start so that they can continue on failure. Signed-off-by: Anil Madhavapeddy <anil@recoil.org>
2016-04-25 14:37:31 +01:00
#!/usr/bin/env bash
update testcases
2016-03-14 00:35:46 -07:00
# Copyright (c) 2015-present, Facebook, Inc. All rights reserved.
Refactor testing framework
2016-03-31 19:14:26 -07:00
formatTest: set undefined variables and let tests continue on fail `set -u` now defines all variables so that undefined variables will trigger a test script failure. `set -e` is disabled before the tests start so that they can continue on failure. Signed-off-by: Anil Madhavapeddy <anil@recoil.org>
2016-04-25 14:37:31 +01:00
set -eu
Fix formatTest under Linux due to incorrect mktemp usage `mktemp` under Debian has a helpfully different syntax from OSX. This caused the test to fail with an error message, and the lack of `set -e` caused it to continue on and attempt to create a bunch of directories under the root directory. This activates quit-on-error mode in bash and also a more generic mktemp syntax that should work on both platforms. Signed-off-by: Anil Madhavapeddy <anil@recoil.org>
2016-04-25 11:07:44 +01:00
Refactor testing framework
2016-03-31 19:14:26 -07:00
WARNING='\033[0;31m'
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
SUCCESS='\033[0;32m'
Re-enable Pexp_letception tests disabled in #1531 (#1537) * Re-enable Pexp_letception tests disabled in #1531 * Ignore some typecheck tests before OCaml version Introduces a convention that typeCheck tests named like "testName.4.03.0.re" will ignore the compilation step with ocamlc on compiler versions lower than the version in the test name. A test named as in the example would only be compiled on OCaml 4.03.0 and later. Moves the let-exception tests into their own file that runs only on OCaml versions >= 4.04. Displays a notice in the output if the file's compilation step was skipped.
2017-10-30 15:29:26 -07:00
NOTICE='\033[0;33m'
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
INFO=''
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
DEBUG=''
Refactor testing framework
2016-03-31 19:14:26 -07:00
RESET='\033[0m'
formatTest: set undefined variables and let tests continue on fail `set -u` now defines all variables so that undefined variables will trigger a test script failure. `set -e` is disabled before the tests start so that they can continue on failure. Signed-off-by: Anil Madhavapeddy <anil@recoil.org>
2016-04-25 14:37:31 +01:00
VERBOSE=${VERBOSE:-}
[Test] Use OCaml version that is installed (#1117)
2017-03-07 15:53:00 -08:00
OCAML_VERSION=`echo $(ocaml -version) | egrep -o '[0-9]+.[0-9]+.[0-9]+' | head -1`
Default OCAML_VERSION env var to 4.02.3 in ./tests.sh
2017-03-03 21:12:34 +01:00
OCAML_VERSION=${OCAML_VERSION:-"4.02.3"}
Refactor testing framework
2016-03-31 19:14:26 -07:00
DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )"
[Reason] Cut Build Time In Half. Summary: 1. One thing that contributors report as being a major point of friction to contributing to the `Reason` repo is the long build times. This diff ports the build to `jbuilder` which reduces the clean build times by around 60%! Incremental build time is also reduced by 50% when making changes to the parser. I'm personally a lot more inclined to fix/improve Reason when the build times are much faster. This brings cold builds down from 24seconds to 11seconds and incremental builds (when changing parser/printer) from 15seconds to 8seconds. 2. Since this uses `jbuilder`, it also allows easily removing the `utop` dependency in the next diff. (I don't know how to refactor `ocamlbuild` projects (`_tags`, `myocamlbuild`, wat.), but here, I just guessed how to do stuff with `jbuilder` and most of the time it worked.) I pulled apart [Rudi's initial port](https://github.com/facebook/reason/pull/1261) and fixed some of the remaining issues. I also refactored the diff to be a little less aggressive and fixed the remaining issues. 3. Completeness: - `make test` works. - Documentation in `./src/README.md` updated. - `opam pin add reason .` works. - I tested `rebuild` on a sample project. - I disabled one test momentarily (the oprint test) because it requires a modern version of node with `async` which I don't have. I'll reenable and test it before we merge this. Test Plan:make test Reviewers:@chenglou, @cristianoc, @IwanKaramazow, @rickyvetter CC:
2017-10-30 22:40:16 -07:00
REFMT="$DIR/../_build/install/default/bin/refmt"
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
OPRINT_TEST_BIN="$DIR/../_build/default/src/reason-parser-tests/testOprint.exe"
Refactor testing framework
2016-03-31 19:14:26 -07:00
reasonfmt -> refmt (#360)
2016-04-20 14:23:56 -07:00
if [[ -f REFMT ]];
Refactor testing framework
2016-03-31 19:14:26 -07:00
then
reasonfmt -> refmt (#360)
2016-04-20 14:23:56 -07:00
echo "Cannot find refmt at $REFMT" 1>&2
Refactor testing framework
2016-03-31 19:14:26 -07:00
exit 1;
fi
Progressively enhance test diff view If you have icdiff (seriously, go get it), it'll show you word-wise side-by-side diff
2017-10-05 01:57:32 -07:00
# for better visual diffing in the terminal, try https://github.com/jeffkaufman/icdiff
Prefer git diff over normal diff for test results (#1578) * Prefer git diff for diffs from expected test results * Add --no-pager to flags for git diff
2017-10-31 17:06:39 -07:00
if hash icdiff 2> /dev/null; then
DIFF="icdiff"
elif hash git 2> /dev/null; then
DIFF="git --no-pager diff --no-index"
Progressively enhance test diff view If you have icdiff (seriously, go get it), it'll show you word-wise side-by-side diff
2017-10-05 01:57:32 -07:00
else
Prefer git diff over normal diff for test results (#1578) * Prefer git diff for diffs from expected test results * Add --no-pager to flags for git diff
2017-10-31 17:06:39 -07:00
DIFF="eval diff --unchanged-line-format='' --new-line-format=':%dn: %L' --old-line-format=':%dn: %L'"
Progressively enhance test diff view If you have icdiff (seriously, go get it), it'll show you word-wise side-by-side diff
2017-10-05 01:57:32 -07:00
fi
Refactor testing framework
2016-03-31 19:14:26 -07:00
UNIT_TEST_INPUT=$DIR/unit_tests/input
Small refactor to keep actual tests output alongside expected ouput (#894)
2016-12-12 20:39:02 -08:00
UNIT_TEST_OUTPUT=$DIR/unit_tests/actual_output
Refactor testing framework
2016-03-31 19:14:26 -07:00
UNIT_TEST_EXPECTED_OUTPUT=$DIR/unit_tests/expected_output
[Reason] Fixup Test Suite (Wrap at 50chars, commit typeCheckedTests to repo). Summary:The existing tests were created such that interesting wrapping events would occur at 50 characters, so restoring that print width config as well as changing the test script to track the expected output of tests that must type check. Test Plan: Reviewers:@yunxing CC:
2016-04-08 00:33:15 -07:00
TYPE_TEST_INPUT=$DIR/typeCheckedTests/input
Refactor testing framework
2016-03-31 19:14:26 -07:00
Small refactor to keep actual tests output alongside expected ouput (#894)
2016-12-12 20:39:02 -08:00
TYPE_TEST_OUTPUT=$DIR/typeCheckedTests/actual_output
Refactor testing framework
2016-03-31 19:14:26 -07:00
[Reason] Fixup Test Suite (Wrap at 50chars, commit typeCheckedTests to repo). Summary:The existing tests were created such that interesting wrapping events would occur at 50 characters, so restoring that print width config as well as changing the test script to track the expected output of tests that must type check. Test Plan: Reviewers:@yunxing CC:
2016-04-08 00:33:15 -07:00
TYPE_TEST_EXPECTED_OUTPUT=$DIR/typeCheckedTests/expected_output
add error tests
2016-04-24 18:46:00 -07:00
ERROR_TEST_INPUT=$DIR/errorTests/input
Small refactor to keep actual tests output alongside expected ouput (#894)
2016-12-12 20:39:02 -08:00
ERROR_TEST_OUTPUT=$DIR/errorTests/actual_output
add error tests
2016-04-24 18:46:00 -07:00
ERROR_TEST_EXPECTED_OUTPUT=$DIR/errorTests/expected_output
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
OPRINT_TEST_INPUT=$DIR/oprintTests/input
OPRINT_TEST_OUTPUT=$DIR/oprintTests/actual_output
OPRINT_TEST_EXPECTED_OUTPUT=$DIR/oprintTests/expected_output
OPRINT_TEST_INTF_OUTPUT=$DIR/oprintTests/intf_output
Small refactor to keep actual tests output alongside expected ouput (#894)
2016-12-12 20:39:02 -08:00
FAILED_TESTS=$DIR/failed_tests
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
Refactor testing framework
2016-03-31 19:14:26 -07:00
function info() {
printf "${INFO}$1${RESET}\n"
}
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
function debug() {
if [ ! -z "$VERBOSE" ]; then
fix tests on linux machines: implementation files must come before interface files
2016-05-04 11:40:50 +02:00
printf "${DEBUG}$1${RESET}\n"
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
fi
}
Re-enable Pexp_letception tests disabled in #1531 (#1537) * Re-enable Pexp_letception tests disabled in #1531 * Ignore some typecheck tests before OCaml version Introduces a convention that typeCheck tests named like "testName.4.03.0.re" will ignore the compilation step with ocamlc on compiler versions lower than the version in the test name. A test named as in the example would only be compiled on OCaml 4.03.0 and later. Moves the let-exception tests into their own file that runs only on OCaml versions >= 4.04. Displays a notice in the output if the file's compilation step was skipped.
2017-10-30 15:29:26 -07:00
function notice() {
printf "${NOTICE}$1${RESET}\n"
}
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
function success() {
Clean up tests display (#1543) Remove noisy warnings
2017-10-24 00:21:51 -07:00
printf "${SUCCESS}$1${RESET}"
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
}
Refactor testing framework
2016-03-31 19:14:26 -07:00
function output() {
printf "$1\n"
}
function warning() {
printf "${WARNING}$1${RESET}\n"
}
Re-enable Pexp_letception tests disabled in #1531 (#1537) * Re-enable Pexp_letception tests disabled in #1531 * Ignore some typecheck tests before OCaml version Introduces a convention that typeCheck tests named like "testName.4.03.0.re" will ignore the compilation step with ocamlc on compiler versions lower than the version in the test name. A test named as in the example would only be compiled on OCaml 4.03.0 and later. Moves the let-exception tests into their own file that runs only on OCaml versions >= 4.04. Displays a notice in the output if the file's compilation step was skipped.
2017-10-30 15:29:26 -07:00
function version() {
echo "$@" | awk -F . '{ printf("%03d%03d%03d\n", $1, $2, $3); }';
}
Refactor testing framework
2016-03-31 19:14:26 -07:00
function setup_test_dir() {
Small refactor to keep actual tests output alongside expected ouput (#894)
2016-12-12 20:39:02 -08:00
echo "Setting up test dirs actual_output alongside the tests' expected_output"
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
mkdir -p $UNIT_TEST_OUTPUT $TYPE_TEST_OUTPUT $ERROR_TEST_OUTPUT $OPRINT_TEST_OUTPUT $OPRINT_TEST_INTF_OUTPUT
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
touch $FAILED_TESTS
Refactor testing framework
2016-03-31 19:14:26 -07:00
}
setup_test_dir
formatTest: set undefined variables and let tests continue on fail `set -u` now defines all variables so that undefined variables will trigger a test script failure. `set -e` is disabled before the tests start so that they can continue on failure. Signed-off-by: Anil Madhavapeddy <anil@recoil.org>
2016-04-25 14:37:31 +01:00
set +e
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
function stdin_test() {
INPUT_FILE=$1
OUTPUT_FILE=$2
EXPECTED_OUTPUT_FILE=$3
# explicitly pass in heuristics file because idempotent tests read from output directory
HEURISTICS_FILE=$4
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
if [[ -z "${5-}" ]]; then
EXTRA_FLAGS='--interface false --parse re'
else
EXTRA_FLAGS="$5"
fi
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
FILENAME=$(basename $INPUT_FILE)
FILEEXT="${FILENAME##*.}"
if [[ $FILEEXT = "re" ]]; then
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
cat $INPUT_FILE | $REFMT $EXTRA_FLAGS --print-width 50 --print re 2>&1 > $OUTPUT_FILE
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
elif [[ $FILEEXT = "rei" ]]; then
Deprecating explicit --use-stdin (#943)
2017-01-09 11:37:34 -08:00
cat $INPUT_FILE | $REFMT --interface true --print-width 50 --parse re --print re 2>&1 > $OUTPUT_FILE
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
elif [[ $FILEEXT = "ml" ]]; then
Deprecating explicit --use-stdin (#943)
2017-01-09 11:37:34 -08:00
cat $INPUT_FILE | $REFMT --heuristics-file $HEURISTICS_FILE --interface false --print-width 50 --parse ml --print re 2>&1 > $OUTPUT_FILE
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
elif [[ $FILEEXT = "mli" ]]; then
Deprecating explicit --use-stdin (#943)
2017-01-09 11:37:34 -08:00
cat $INPUT_FILE | $REFMT --heuristics-file $HEURISTICS_FILE --interface true --print-width 50 --parse ml --print re 2>&1 > $OUTPUT_FILE
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
else
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
warning " ⊘ FAILED --use-stdin \n"
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
info " Cannot determine default implementation parser for extension ${FILEEXT}"
return 1
fi
if ! [[ $? -eq 0 ]]; then
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
warning " ⊘ FAILED --use-stdin \n"
info " There was an error when testing --use-stdin"
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
info " for input file $INPUT_FILE"
info " and output file $OUTPUT_FILE${RESET}"
echo ""
return 1
fi
Make test diff output show actual on the right (#1669) The order was reversed til now (??). Instead of seeing that you added a space, you see that "the old version removed a space". Which isn't the way the change should be interpreted.
2017-11-29 01:36:12 -08:00
debug " Comparing --use-stdin results: diff $EXPECTED_OUTPUT_FILE $OUTPUT_FILE"
$DIFF $EXPECTED_OUTPUT_FILE $OUTPUT_FILE
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
if ! [[ $? -eq 0 ]]; then
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
warning " ⊘ FAILED --use-stdin \n"
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
info " ${INFO}$OUTPUT_FILE${RESET}"
info " doesn't match expected output"
info " ${INFO}$EXPECTED_OUTPUT_FILE${RESET}"
echo ""
return 1
fi
return 0
}
Refactor testing framework
2016-03-31 19:14:26 -07:00
function unit_test() {
FILE=$1
INPUT=$2
OUTPUT=$3
EXPECTED_OUTPUT=$4
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
FILENAME=$(basename $FILE)
FILEEXT="${FILENAME##*.}"
Re-enable 4.02.3 on Circle (#1130) This also adds support for 4.02.3-specific tests that are currently failing on Travis CI.
2017-03-09 12:09:34 -08:00
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
info "Unit Test: $FILE"
[Reason] Tests - Fix interface file tests. Summary:Interface file tests were disabled - reenabling them. Test Plan: Reviewers: CC:
2016-04-11 01:22:19 -07:00
if [ "$(basename $FILE)" != "$(basename $FILE .ml)" ] || [ "$(basename $FILE)" != "$(basename $FILE .mli)" ]; then
if [ "$(basename $FILE)" != "$(basename $FILE .ml)" ]; then
REFILE="$(basename $FILE .ml).re"
else
REFILE="$(basename $FILE .mli).rei"
fi
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
debug "$REFMT --heuristics-file $INPUT/arity.txt --print-width 50 --print re $INPUT/$FILE 2>&1 > $OUTPUT/$REFILE"
$REFMT --heuristics-file $INPUT/arity.txt --print-width 50 --print re $INPUT/$FILE 2>&1 > $OUTPUT/$REFILE
[Reason] Fixup Test Suite (Wrap at 50chars, commit typeCheckedTests to repo). Summary:The existing tests were created such that interesting wrapping events would occur at 50 characters, so restoring that print width config as well as changing the test script to track the expected output of tests that must type check. Test Plan: Reviewers:@yunxing CC:
2016-04-08 00:33:15 -07:00
if ! [[ $? -eq 0 ]]; then
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
warning " ⊘ TEST FAILED CONVERTING ML TO RE\n"
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
return 1
[Reason] Fixup Test Suite (Wrap at 50chars, commit typeCheckedTests to repo). Summary:The existing tests were created such that interesting wrapping events would occur at 50 characters, so restoring that print width config as well as changing the test script to track the expected output of tests that must type check. Test Plan: Reviewers:@yunxing CC:
2016-04-08 00:33:15 -07:00
fi
FILE=$REFILE
else
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
debug " '$REFMT --print-width 50 --print re $INPUT/$FILE 2>&1 > $OUTPUT/$FILE'"
$REFMT --print-width 50 --print re $INPUT/$FILE 2>&1 > $OUTPUT/$FILE
[Reason] Fixup Test Suite (Wrap at 50chars, commit typeCheckedTests to repo). Summary:The existing tests were created such that interesting wrapping events would occur at 50 characters, so restoring that print width config as well as changing the test script to track the expected output of tests that must type check. Test Plan: Reviewers:@yunxing CC:
2016-04-08 00:33:15 -07:00
fi
Refactor testing framework
2016-03-31 19:14:26 -07:00
Re-enable 4.02.3 on Circle (#1130) This also adds support for 4.02.3-specific tests that are currently failing on Travis CI.
2017-03-09 12:09:34 -08:00
OFILE="${FILE}"
VERSION_SPECIFIC_FILE="${FILE}.${OCAML_VERSION}"
if [ -f "${EXPECTED_OUTPUT}/${VERSION_SPECIFIC_FILE}" ]; then
echo "Found test file specific to version ${OCAML_VERSION}..."
OFILE="${VERSION_SPECIFIC_FILE}"
fi
Make test diff output show actual on the right (#1669) The order was reversed til now (??). Instead of seeing that you added a space, you see that "the old version removed a space". Which isn't the way the change should be interpreted.
2017-11-29 01:36:12 -08:00
debug " Comparing results: diff $EXPECTED_OUTPUT/$OFILE $OUTPUT/$FILE"
Refactor testing framework
2016-03-31 19:14:26 -07:00
Make test diff output show actual on the right (#1669) The order was reversed til now (??). Instead of seeing that you added a space, you see that "the old version removed a space". Which isn't the way the change should be interpreted.
2017-11-29 01:36:12 -08:00
$DIFF $EXPECTED_OUTPUT/$OFILE $OUTPUT/$FILE
Refactor testing framework
2016-03-31 19:14:26 -07:00
if ! [[ $? -eq 0 ]]; then
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
warning " ⊘ FAILED\n"
info " ${INFO}$OUTPUT/$FILE${RESET}"
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
info " doesn't match expected output"
Re-enable 4.02.3 on Circle (#1130) This also adds support for 4.02.3-specific tests that are currently failing on Travis CI.
2017-03-09 12:09:34 -08:00
info " ${INFO}$EXPECTED_OUTPUT/$OFILE${RESET}"
Simplify detection of M.(P.(foo)) Summary:This cleans up the code a bit. Test Plan: Reviewers:chenglou, iwankaramazow CC:
2017-11-18 21:00:43 -08:00
info ""
info " To approve the changes run:"
info " cp $OUTPUT/$FILE $EXPECTED_OUTPUT/$OFILE"
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
echo ""
return 1
Refactor testing framework
2016-03-31 19:14:26 -07:00
fi
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
debug "Testing --use-stdin"
Re-enable 4.02.3 on Circle (#1130) This also adds support for 4.02.3-specific tests that are currently failing on Travis CI.
2017-03-09 12:09:34 -08:00
stdin_test $INPUT/$1 $OUTPUT/$FILE $EXPECTED_OUTPUT/$OFILE $INPUT/arity.txt
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
if ! [[ $? -eq 0 ]]; then
return 1
else
success " ☑ PASS"
echo
fi
Refactor testing framework
2016-03-31 19:14:26 -07:00
}
Initial Commit
2016-02-19 16:36:03 -08:00
function idempotent_test() {
Refactor testing framework
2016-03-31 19:14:26 -07:00
FILE=$1
INPUT=$2
OUTPUT=$3
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
EXTRA_FLAGS=${5-}
Initial Commit
2016-02-19 16:36:03 -08:00
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
FILENAME=$(basename $FILE)
FILEEXT="${FILENAME##*.}"
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
info "Idempotent Test: $FILE"
Fix bugs introduced by last diff
2016-04-11 01:57:43 -07:00
if [ "$(basename $FILE)" != "$(basename $FILE .ml)" ] || [ "$(basename $FILE)" != "$(basename $FILE .mli)" ]; then
[Reason] Tests - Fix interface file tests. Summary:Interface file tests were disabled - reenabling them. Test Plan: Reviewers: CC:
2016-04-11 01:22:19 -07:00
if [ "$(basename $FILE)" != "$(basename $FILE .ml)" ]; then
REFILE="$(basename $FILE .ml).re"
else
REFILE="$(basename $FILE .mli).rei"
fi
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
debug " Converting $FILE to $REFILE:"
Refactor testing framework
2016-03-31 19:14:26 -07:00
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
debug " Formatting Once: $REFMT $EXTRA_FLAGS --heuristics-file $INPUT/arity.txt --print-width 50 --print re $INPUT/$FILE 2>&1 > $OUTPUT/$REFILE"
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
$REFMT --heuristics-file $INPUT/arity.txt --print-width 50 --print re $INPUT/$FILE 2>&1 > $OUTPUT/$REFILE
[Reason] Fixup Test Suite (Wrap at 50chars, commit typeCheckedTests to repo). Summary:The existing tests were created such that interesting wrapping events would occur at 50 characters, so restoring that print width config as well as changing the test script to track the expected output of tests that must type check. Test Plan: Reviewers:@yunxing CC:
2016-04-08 00:33:15 -07:00
if ! [[ $? -eq 0 ]]; then
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
warning "⊘ FAILED\n"
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
return 1
[Reason] Fixup Test Suite (Wrap at 50chars, commit typeCheckedTests to repo). Summary:The existing tests were created such that interesting wrapping events would occur at 50 characters, so restoring that print width config as well as changing the test script to track the expected output of tests that must type check. Test Plan: Reviewers:@yunxing CC:
2016-04-08 00:33:15 -07:00
fi
FILE=$REFILE
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
debug " Generating output again: $REFMT $EXTRA_FLAGS --print-width 50 --print re $OUTPUT/$FILE 2>&1 > $OUTPUT/$FILE.formatted"
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
$REFMT --print-width 50 --print re $OUTPUT/$FILE 2>&1 > $OUTPUT/$FILE.formatted
[Reason] Fixup Test Suite (Wrap at 50chars, commit typeCheckedTests to repo). Summary:The existing tests were created such that interesting wrapping events would occur at 50 characters, so restoring that print width config as well as changing the test script to track the expected output of tests that must type check. Test Plan: Reviewers:@yunxing CC:
2016-04-08 00:33:15 -07:00
else
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
debug " Formatting Once: '$REFMT $EXTRA_FLAGS --print-width 50 --print re $INPUT/$FILE 2>&1 > $OUTPUT/$FILE'"
$REFMT $EXTRA_FLAGS --print-width 50 --print re $INPUT/$FILE 2>&1 > $OUTPUT/$FILE
[Reason] Fixup Test Suite (Wrap at 50chars, commit typeCheckedTests to repo). Summary:The existing tests were created such that interesting wrapping events would occur at 50 characters, so restoring that print width config as well as changing the test script to track the expected output of tests that must type check. Test Plan: Reviewers:@yunxing CC:
2016-04-08 00:33:15 -07:00
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
debug " Generating output again: $REFMT $EXTRA_FLAGS --print-width 50 --print re $OUTPUT/$FILE 2>&1 > $OUTPUT/$FILE.formatted"
$REFMT $EXTRA_FLAGS --print-width 50 --print re $OUTPUT/$FILE 2>&1 > $OUTPUT/$FILE.formatted
[Reason] Fixup Test Suite (Wrap at 50chars, commit typeCheckedTests to repo). Summary:The existing tests were created such that interesting wrapping events would occur at 50 characters, so restoring that print width config as well as changing the test script to track the expected output of tests that must type check. Test Plan: Reviewers:@yunxing CC:
2016-04-08 00:33:15 -07:00
fi
Refactor testing framework
2016-03-31 19:14:26 -07:00
Progressively enhance test diff view If you have icdiff (seriously, go get it), it'll show you word-wise side-by-side diff
2017-10-05 01:57:32 -07:00
$DIFF $OUTPUT/$FILE $OUTPUT/$FILE.formatted
Initial Commit
2016-02-19 16:36:03 -08:00
if ! [[ $? -eq 0 ]]; then
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
warning "⊘ FAILED\n"
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
info " ${INFO}$OUTPUT/$FILE.formatted${RESET}\n"
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
info " is not same as"
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
info " ${INFO}$OUTPUT/$FILE${RESET}"
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
return 1
Initial Commit
2016-02-19 16:36:03 -08:00
fi
Refactor testing framework
2016-03-31 19:14:26 -07:00
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
debug "Testing --use-stdin"
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
stdin_test $INPUT/$1 $OUTPUT/$FILE $OUTPUT/$FILE $INPUT/arity.txt "$EXTRA_FLAGS"
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
if ! [[ $? -eq 0 ]]; then
return 1
else
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
stdin_test $OUTPUT/$FILE $OUTPUT/$FILE.formatted $OUTPUT/$FILE $INPUT/arity.txt "$EXTRA_FLAGS"
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
if ! [[ $? -eq 0 ]]; then
return 1
else
success " ☑ PASS"
echo
fi
fi
Initial Commit
2016-02-19 16:36:03 -08:00
}
Refactor testing framework
2016-03-31 19:14:26 -07:00
function typecheck_test() {
Re-enable Pexp_letception tests disabled in #1531 (#1537) * Re-enable Pexp_letception tests disabled in #1531 * Ignore some typecheck tests before OCaml version Introduces a convention that typeCheck tests named like "testName.4.03.0.re" will ignore the compilation step with ocamlc on compiler versions lower than the version in the test name. A test named as in the example would only be compiled on OCaml 4.03.0 and later. Moves the let-exception tests into their own file that runs only on OCaml versions >= 4.04. Displays a notice in the output if the file's compilation step was skipped.
2017-10-30 15:29:26 -07:00
FILE=$(basename $1)
Refactor testing framework
2016-03-31 19:14:26 -07:00
INPUT=$2
OUTPUT=$3
Initial Commit
2016-02-19 16:36:03 -08:00
Re-enable Pexp_letception tests disabled in #1531 (#1537) * Re-enable Pexp_letception tests disabled in #1531 * Ignore some typecheck tests before OCaml version Introduces a convention that typeCheck tests named like "testName.4.03.0.re" will ignore the compilation step with ocamlc on compiler versions lower than the version in the test name. A test named as in the example would only be compiled on OCaml 4.03.0 and later. Moves the let-exception tests into their own file that runs only on OCaml versions >= 4.04. Displays a notice in the output if the file's compilation step was skipped.
2017-10-30 15:29:26 -07:00
info "Typecheck Test: $1"
if [ "$FILE" != "$(basename $FILE .ml)" ] || [ "$FILE" != "$(basename $FILE .mli)" ]; then
if [ "$FILE" != "$(basename $FILE .ml)" ]; then
REFILE="$(basename $FILE .ml).re"
[Reason] Tests - Fix interface file tests. Summary:Interface file tests were disabled - reenabling them. Test Plan: Reviewers: CC:
2016-04-11 01:22:19 -07:00
else
Re-enable Pexp_letception tests disabled in #1531 (#1537) * Re-enable Pexp_letception tests disabled in #1531 * Ignore some typecheck tests before OCaml version Introduces a convention that typeCheck tests named like "testName.4.03.0.re" will ignore the compilation step with ocamlc on compiler versions lower than the version in the test name. A test named as in the example would only be compiled on OCaml 4.03.0 and later. Moves the let-exception tests into their own file that runs only on OCaml versions >= 4.04. Displays a notice in the output if the file's compilation step was skipped.
2017-10-30 15:29:26 -07:00
REFILE="$(basename $FILE .mli).rei"
[Reason] Tests - Fix interface file tests. Summary:Interface file tests were disabled - reenabling them. Test Plan: Reviewers: CC:
2016-04-11 01:22:19 -07:00
fi
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
debug " Converting $FILE to $REFILE:"
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
debug "$REFMT --heuristics-file $INPUT/arity.txt --print-width 50 --print re $INPUT/$FILE 2>&1 > $OUTPUT/$REFILE"
$REFMT --heuristics-file $INPUT/arity.txt --print-width 50 --print re $INPUT/$FILE 2>&1 > $OUTPUT/$REFILE
Refactor testing framework
2016-03-31 19:14:26 -07:00
if ! [[ $? -eq 0 ]]; then
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
warning " ⊘ FAILED\n"
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
return 1
Refactor testing framework
2016-03-31 19:14:26 -07:00
fi
FILE=$REFILE
else
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
debug " Formatting: $REFMT --print-width 50 --print re $INPUT/$FILE 2>&1 > $OUTPUT/$FILE"
$REFMT --print-width 50 --print re $INPUT/$FILE 2>&1 > $OUTPUT/$FILE
Refactor testing framework
2016-03-31 19:14:26 -07:00
if ! [[ $? -eq 0 ]]; then
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
warning " ⊘ FAILED\n"
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
return 1
Refactor testing framework
2016-03-31 19:14:26 -07:00
fi
fi
Re-enable Pexp_letception tests disabled in #1531 (#1537) * Re-enable Pexp_letception tests disabled in #1531 * Ignore some typecheck tests before OCaml version Introduces a convention that typeCheck tests named like "testName.4.03.0.re" will ignore the compilation step with ocamlc on compiler versions lower than the version in the test name. A test named as in the example would only be compiled on OCaml 4.03.0 and later. Moves the let-exception tests into their own file that runs only on OCaml versions >= 4.04. Displays a notice in the output if the file's compilation step was skipped.
2017-10-30 15:29:26 -07:00
if [ "$FILE" != "$(basename $FILE .re)" ]; then
SUFFIX=".re"
COMPILE_FLAGS="-intf-suffix .rei -impl"
[Reason] Tests - Fix interface file tests. Summary:Interface file tests were disabled - reenabling them. Test Plan: Reviewers: CC:
2016-04-11 01:22:19 -07:00
else
Re-enable Pexp_letception tests disabled in #1531 (#1537) * Re-enable Pexp_letception tests disabled in #1531 * Ignore some typecheck tests before OCaml version Introduces a convention that typeCheck tests named like "testName.4.03.0.re" will ignore the compilation step with ocamlc on compiler versions lower than the version in the test name. A test named as in the example would only be compiled on OCaml 4.03.0 and later. Moves the let-exception tests into their own file that runs only on OCaml versions >= 4.04. Displays a notice in the output if the file's compilation step was skipped.
2017-10-30 15:29:26 -07:00
SUFFIX=".rei"
COMPILE_FLAGS="-intf"
[Reason] Tests - Fix interface file tests. Summary:Interface file tests were disabled - reenabling them. Test Plan: Reviewers: CC:
2016-04-11 01:22:19 -07:00
fi
Initial Commit
2016-02-19 16:36:03 -08:00
Re-enable Pexp_letception tests disabled in #1531 (#1537) * Re-enable Pexp_letception tests disabled in #1531 * Ignore some typecheck tests before OCaml version Introduces a convention that typeCheck tests named like "testName.4.03.0.re" will ignore the compilation step with ocamlc on compiler versions lower than the version in the test name. A test named as in the example would only be compiled on OCaml 4.03.0 and later. Moves the let-exception tests into their own file that runs only on OCaml versions >= 4.04. Displays a notice in the output if the file's compilation step was skipped.
2017-10-30 15:29:26 -07:00
BASE_NAME=$(echo $FILE | cut -d '.' -f 1)
MIN_VERSION=$(basename $FILE $SUFFIX | cut -d '.' -f 2-4)
if [ "$MIN_VERSION" != "$BASE_NAME" ] && [ "$(version "$OCAML_VERSION")" -lt "$(version "$MIN_VERSION")" ]
then
notice " ☒ IGNORED COMPILATION STEP: Requires OCaml >= $MIN_VERSION"
else
debug " Compiling: ocamlc -c -pp $REFMT $COMPILE_FLAGS $OUTPUT/$FILE"
ocamlc -c -pp "$REFMT --print binary" $COMPILE_FLAGS "$OUTPUT/$FILE"
if ! [[ $? -eq 0 ]]; then
warning " ⊘ FAILED\n"
return 1
fi
Refactor testing framework
2016-03-31 19:14:26 -07:00
fi
Initial Commit
2016-02-19 16:36:03 -08:00
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
success " ☑ PASS"
Refactor testing framework
2016-03-31 19:14:26 -07:00
echo
}
Make test: Add feature to test custom ML files Custom ML files that are put into this directory will also be format tested
2016-02-25 23:24:22 -08:00
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
function oprint_test() {
FILE=$1
INPUT=$2
OUTPUT=$3
EXPECTED_OUTPUT=$4
INTF_OUTPUT=$5
FILENAME=$(basename $FILE)
FILEEXT="${FILENAME##*.}"
info "Outcome Printer Test: $FILE"
debug " 'cat $FILE | $OPRINT_TEST_BIN $INPUT/$FILE 2>&1 > $OUTPUT/$FILE'"
cat $INPUT/$FILE | $OPRINT_TEST_BIN $INPUT/$FILE 2>&1 > $OUTPUT/$FILE
debug " 'cp $OUTPUT/$FILE $INTF_OUTPUT/$(basename $FILE .re).rei"
cp $OUTPUT/$FILE $INTF_OUTPUT/$(basename $FILE .re).rei
OFILE="${FILE}"
VERSION_SPECIFIC_FILE="${FILE}.${OCAML_VERSION}"
if [ -f "${EXPECTED_OUTPUT}/${VERSION_SPECIFIC_FILE}" ]; then
echo "Found test file specific to version ${OCAML_VERSION}..."
OFILE="${VERSION_SPECIFIC_FILE}"
fi
debug " Comparing results: diff $EXPECTED_OUTPUT/$OFILE $OUTPUT/$FILE"
$DIFF $EXPECTED_OUTPUT/$OFILE $OUTPUT/$FILE
if ! [[ $? -eq 0 ]]; then
warning " ⊘ FAILED\n"
info " ${INFO}$OUTPUT/$FILE${RESET}"
info " doesn't match expected output"
info " ${INFO}$EXPECTED_OUTPUT/$OFILE${RESET}"
info ""
info " To approve the changes run:"
info " cp $OUTPUT/$FILE $EXPECTED_OUTPUT/$OFILE"
echo ""
return 1
fi
if ! [[ $? -eq 0 ]]; then
return 1
else
success " ☑ PASS"
echo
fi
}
add error tests
2016-04-24 18:46:00 -07:00
function error_test() {
FILE=$1
INPUT=$2
OUTPUT=$3
EXPECTED_OUTPUT=$4
info "Error Test: $FILE"
if [ "$(basename $FILE)" != "$(basename $FILE .ml)" ] || [ "$(basename $FILE)" != "$(basename $FILE .mli)" ]; then
warning " ⊘ FAILED: .ml files should not need to be run against error tests. \n"
return 1
else
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
debug " '$REFMT --print-width 50 --print re $INPUT/$FILE &> $OUTPUT/$FILE'"
add error tests
2016-04-24 18:46:00 -07:00
# ensure errors are not absolute filepaths
cd $INPUT
Deprecating single hyphen refmt args (#935)
2017-01-06 01:13:29 -08:00
$REFMT --print-width 50 --print re $(basename $FILE) &> $OUTPUT/$FILE
Extend test suite with -use-stdin tests for both idempotent and unit tests.
2016-04-18 22:42:20 -07:00
cd - > /dev/null
add error tests
2016-04-24 18:46:00 -07:00
fi
Make test diff output show actual on the right (#1669) The order was reversed til now (??). Instead of seeing that you added a space, you see that "the old version removed a space". Which isn't the way the change should be interpreted.
2017-11-29 01:36:12 -08:00
debug " Comparing results: diff $EXPECTED_OUTPUT/$FILE $OUTPUT/$FILE"
add error tests
2016-04-24 18:46:00 -07:00
Make test diff output show actual on the right (#1669) The order was reversed til now (??). Instead of seeing that you added a space, you see that "the old version removed a space". Which isn't the way the change should be interpreted.
2017-11-29 01:36:12 -08:00
$DIFF $EXPECTED_OUTPUT/$FILE $OUTPUT/$FILE
add error tests
2016-04-24 18:46:00 -07:00
if ! [[ $? -eq 0 ]]; then
warning " ⊘ FAILED\n"
info " ${INFO}$OUTPUT/$FILE${RESET}"
info " doesn't match expected output"
info " ${INFO}$EXPECTED_OUTPUT/$FILE${RESET}"
Simplify detection of M.(P.(foo)) Summary:This cleans up the code a bit. Test Plan: Reviewers:chenglou, iwankaramazow CC:
2017-11-18 21:00:43 -08:00
info ""
info " To approve the changes run:"
info " cp $OUTPUT/$FILE $EXPECTED_OUTPUT/$FILE"
add error tests
2016-04-24 18:46:00 -07:00
echo ""
return 1
fi
success " ☑ PASS"
echo
}
Automatically generate show functions for user-defined types (#1041) * WIP * WIP doesn't even compile * Working...! * Slim down interface * Test for failure on multi-types * Clean up PR * Further clean up PR * Do not depend on ppx_deriving * Add command-line option to add printers Defaults to false * Adhere to naming conventions * Move runtime to better place * Cleanup * Add recursive type declarations * Remove useless comment * Fix merlin errors for vendored package and package.ml * Fix indentation level of `in' * Prepend runtime to start of file * Add "nonrec" attribute to type aliases * Add NB about parse-time performance penalty * Remove -a shortcut for --add-printers * Add NB about idempotence * Vendor ppx_tools.metaquot's Ast_convenience * No need for the actual runtime file ayy * Whoops, actually include all necessary functions * Update .merlin * Add test of --add-printers * Add new dep on result * Version 1.8.1
2017-02-16 15:24:01 -08:00
Outcome Printer Test Infrastructure (#2213)
2018-10-08 21:07:45 +01:00
cd $OPRINT_TEST_INPUT && find . -type f \( -name "*.re*" -or -name "*.ml*" \) | while read file; do
oprint_test $file $OPRINT_TEST_INPUT $OPRINT_TEST_OUTPUT $OPRINT_TEST_EXPECTED_OUTPUT $OPRINT_TEST_INTF_OUTPUT
if ! [[ $? -eq 0 ]]; then
echo "$file -- failed unit_test" >> $FAILED_TESTS
fi
idempotent_test $file $OPRINT_TEST_OUTPUT $OPRINT_TEST_INTF_OUTPUT $OPRINT_TEST_EXPECTED_OUTPUT '-i true --parse re'
if ! [[ $? -eq 0 ]]; then
echo "$file -- failed idempotent_test" >> $FAILED_TESTS
fi
done
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
cd $UNIT_TEST_INPUT && find . -type f \( -name "*.re*" -or -name "*.ml*" \) | while read file; do
Refactor testing framework
2016-03-31 19:14:26 -07:00
unit_test $file $UNIT_TEST_INPUT $UNIT_TEST_OUTPUT $UNIT_TEST_EXPECTED_OUTPUT
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
if ! [[ $? -eq 0 ]]; then
[Test] Small error output tweak to avoid misunderstandings I was searching for e.g. `attributes.re` in `unit_test/` because the way the error was displayed led me to believe it was in that folder.
2016-06-12 22:22:03 -07:00
echo "$file -- failed unit_test" >> $FAILED_TESTS
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
fi
Refactor testing framework
2016-03-31 19:14:26 -07:00
idempotent_test $file $UNIT_TEST_INPUT $UNIT_TEST_OUTPUT $UNIT_TEST_EXPECTED_OUTPUT
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
if ! [[ $? -eq 0 ]]; then
[Test] Small error output tweak to avoid misunderstandings I was searching for e.g. `attributes.re` in `unit_test/` because the way the error was displayed led me to believe it was in that folder.
2016-06-12 22:22:03 -07:00
echo "$file -- failed idempotent_test" >> $FAILED_TESTS
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
fi
Make test: Add feature to test custom ML files Custom ML files that are put into this directory will also be format tested
2016-02-25 23:24:22 -08:00
done
Re-enable Pexp_letception tests disabled in #1531 (#1537) * Re-enable Pexp_letception tests disabled in #1531 * Ignore some typecheck tests before OCaml version Introduces a convention that typeCheck tests named like "testName.4.03.0.re" will ignore the compilation step with ocamlc on compiler versions lower than the version in the test name. A test named as in the example would only be compiled on OCaml 4.03.0 and later. Moves the let-exception tests into their own file that runs only on OCaml versions >= 4.04. Displays a notice in the output if the file's compilation step was skipped.
2017-10-30 15:29:26 -07:00
cd $TYPE_TEST_INPUT
find . -type f \( -name "*.re*" -or -name "*.ml*" \) | sort | while read file; do
Refactor testing framework
2016-03-31 19:14:26 -07:00
typecheck_test $file $TYPE_TEST_INPUT $TYPE_TEST_OUTPUT
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
if ! [[ $? -eq 0 ]]; then
[Test] Small error output tweak to avoid misunderstandings I was searching for e.g. `attributes.re` in `unit_test/` because the way the error was displayed led me to believe it was in that folder.
2016-06-12 22:22:03 -07:00
echo "$file -- failed typecheck_test" >> $FAILED_TESTS
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
fi
[Reason] Fixup Test Suite (Wrap at 50chars, commit typeCheckedTests to repo). Summary:The existing tests were created such that interesting wrapping events would occur at 50 characters, so restoring that print width config as well as changing the test script to track the expected output of tests that must type check. Test Plan: Reviewers:@yunxing CC:
2016-04-08 00:33:15 -07:00
unit_test $file $TYPE_TEST_INPUT $TYPE_TEST_OUTPUT $TYPE_TEST_EXPECTED_OUTPUT
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
if ! [[ $? -eq 0 ]]; then
[Test] Small error output tweak to avoid misunderstandings I was searching for e.g. `attributes.re` in `unit_test/` because the way the error was displayed led me to believe it was in that folder.
2016-06-12 22:22:03 -07:00
echo "$file -- failed unit_test" >> $FAILED_TESTS
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
fi
[Reason] Fixup Test Suite (Wrap at 50chars, commit typeCheckedTests to repo). Summary:The existing tests were created such that interesting wrapping events would occur at 50 characters, so restoring that print width config as well as changing the test script to track the expected output of tests that must type check. Test Plan: Reviewers:@yunxing CC:
2016-04-08 00:33:15 -07:00
idempotent_test $file $TYPE_TEST_INPUT $TYPE_TEST_OUTPUT $TYPE_TEST_EXPECTED_OUTPUT
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
if ! [[ $? -eq 0 ]]; then
[Test] Small error output tweak to avoid misunderstandings I was searching for e.g. `attributes.re` in `unit_test/` because the way the error was displayed led me to believe it was in that folder.
2016-06-12 22:22:03 -07:00
echo "$file -- failed idempotent_test" >> $FAILED_TESTS
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
fi
Refactor testing framework
2016-03-31 19:14:26 -07:00
done
Make test: Add feature to test custom ML files Custom ML files that are put into this directory will also be format tested
2016-02-25 23:24:22 -08:00
add error tests
2016-04-24 18:46:00 -07:00
cd $ERROR_TEST_INPUT && find . -type f \( -name "*.re*" -or -name "*.ml*" \) | while read file; do
error_test $file $ERROR_TEST_INPUT $ERROR_TEST_OUTPUT $ERROR_TEST_EXPECTED_OUTPUT
if ! [[ $? -eq 0 ]]; then
[Test] Small error output tweak to avoid misunderstandings I was searching for e.g. `attributes.re` in `unit_test/` because the way the error was displayed led me to believe it was in that folder.
2016-06-12 22:22:03 -07:00
echo "$file -- failed error_test" >> $FAILED_TESTS
add error tests
2016-04-24 18:46:00 -07:00
fi
done
Better behavior for formatting tests - Correctly set failed tests globally - Default to generate less verbose output unless "VERBOSE" is specified
2016-04-15 17:58:33 +08:00
if [[ -s $FAILED_TESTS ]]; then
warning "Failed tests:"
cat $FAILED_TESTS
[Reason] Better test formatting output/behavior. Summary: The lines are more condensed now. Also, the tests will continue to run after one fails. At the very end, if there was > 1 failure, it will let you know to scroll up to inspect the failure - and that it might be a preexisting failure. Test Plan: Reviewers: CC:
2016-04-12 23:34:30 -07:00
exit 1
Refactor testing framework
2016-03-31 19:14:26 -07:00
fi
Initial Commit
2016-02-19 16:36:03 -08:00
Refactor testing framework
2016-03-31 19:14:26 -07:00
exit 0
Reference in New Issue Copy Permalink