aboutsummaryrefslogtreecommitdiff
path: root/run_project_tests.py
AgeCommit message (Collapse)AuthorFilesLines
2018-02-25Determining whether to run C# tests is so difficult it deserves its own ↵Jussi Pakkanen1-1/+23
function.
2018-02-25Add support for Visual Studio csc c# compilerThibault Saunier1-1/+1
2018-02-21Always run all framework tests on all platformsJon Turney1-14/+31
Always run all framework tests on all platforms, but allow them to be skipped when not running under CI for linux.
2018-02-20Run FPGA tests.Jussi Pakkanen1-0/+1
2018-02-15Verify that failing tests are failing with an error, not a python exceptionJon Turney1-2/+5
PR #2527 suggests "making failing tests more strict about failing gracefully". To achive this, make meson exit with distinct exit statuses for meson errors and python exceptions, and check the exit status is as expected for failing tests. I can't see how to write a test for this, within the current framework. You can test this change by reverting the fix (but not the test) from commit 1a159db8 and verifying that 'test cases/failing/66 string as link target' fails.
2018-01-30run_project_tests: Remove workaround for missing ↵Christoph Reiter1-50/+2
concurrent.futures.ProcessPoolExecutor support This removes the workaround code added in https://github.com/mesonbuild/meson/commit/52e1b0a3c909 The bug in the MSYS2 Python3 build has been fixed for some time now, see https://github.com/Alexpux/MINGW-packages/pull/2619 The original commit noted that this might be helpful for OpenBSD, but that has sem_open support since version 5.5 released 4 years ago: https://www.openbsd.org/55.html
2018-01-09Merge pull request #2803 from dcbaker/wip/freebsd-fixesJussi Pakkanen1-4/+13
various BSD fixes
2018-01-09Only run Boost tests on osx if it is actually installed.Jussi Pakkanen1-1/+5
2018-01-06tests: Split objc and objc++ testsDylan Baker1-3/+12
This allows platforms that can compile one or the other (but not both) to run the tests that they can.
2018-01-06run_project_tests: correctly search for objcpp compilerDylan Baker1-1/+1
Instead of looking for an objc compiler. Fixes objc++ tests on DragonFlyBSD (which has an objc but not an objc++ compiler) Really though, the objc and objc++ tests need to be untangled so that the objc tests can run even if an objc++ compiler is unavilable.
2018-01-06Fix installed files check for gobject-introspection tests on CygwinJon Turney1-0/+1
g-ir-scanner --no-libtool needed some fixes similar to [1] for Cygwin, as well. Now that is done, it's possible to make these tests run and pass on Cygwin. [1] https://bugzilla.gnome.org/show_bug.cgi?id=781525
2018-01-04CI: Run boost test for CygwinJon Turney1-4/+1
Also, use '^' to escape newlines in appveyor-install.bat to avoid an absurdly long line, remove some unnecessary quotation, and alphabetically sort packages Also, define the _XOPEN_SOURCE feature test macro in the boost test to avoid 'not declared in this scope' warnings for pthread_rwlock_init(), etc.
2018-01-01Run the boost test on osx on travis.Benjamin Redelings1-1/+5
2017-12-18Use deterministic builddir so CCache works across invocations.Jussi Pakkanen1-1/+10
2017-11-20Make the full test suite runnable with an external command.Jussi Pakkanen1-2/+19
2017-11-20Replaced sys.executable use with the mesonlib equivalent.Jussi Pakkanen1-1/+1
2017-11-20Tests can be run with an external Meson command.Jussi Pakkanen1-3/+3
2017-09-30Moved prebuilt static library under unit tests.Jussi Pakkanen1-53/+17
2017-09-30Moved prebuilt object test under unittests.Jussi Pakkanen1-5/+3
2017-09-20tests: Only error for lines starting with tabsNirbheek Chauhan1-1/+1
Otherwise we can't even use tabs for testing.
2017-08-31Try to use 2x the number of cores.Jussi Pakkanen1-0/+6
2017-08-02Turned mesontest into on internal module.Jussi Pakkanen1-3/+3
2017-08-02Handle objc compiler missing more reliably.Jussi Pakkanen1-2/+5
2017-07-20Support implibs for executables on WindowsJon Turney1-2/+14
Add a boolean 'implib' kwarg to executable(). If true, it is permitted to use the returned build target object in link_with: On platforms where this makes sense (e.g. Windows), an implib is generated for the executable and used when linking. Otherwise, it has no effect. (Rather than checking if it is a StaticLibrary or SharedLibary, BuildTarget subclasses gain the is_linkable_target method to test if they can appear in link_with:) Also install any executable implib in a similar way to a shared library implib, i.e. placing the implib in the appropriate place Add tests of: - a shared_module containing a reference to a symbol which is known (at link time) to be provided by the executable - trying to link with non-implib executables (should fail) - installing the implib (This last one needs a little enhancement of the installed file checking as this is the first install test we have which needs to work with either MSVC-style or GCC-style implib filenames)
2017-07-18Close files reliably.Jussi Pakkanen1-2/+7
2017-06-23Split out languages from compilers.pyAlistair Thomas1-1/+0
2017-06-22Add some colour to test output.Elliott Sales de Andrade1-7/+26
Bold the section names and colourize errors&skips.
2017-06-21Merge pull request #1924 from mesonbuild/tingping/yelp-fixesJussi Pakkanen1-1/+2
Various yelp fixes
2017-06-17tests: Always consider symlink as valid installed filePatrick Griffis1-1/+2
An installed symlink might point to a non-existing file (because DESTDIR is set) so just always accept them.
2017-06-10tests: Add Boost unit tests and project tests on WindowsNirbheek Chauhan1-3/+10
Boost tests are disabled on Windows for now because the detection is actually completely broken. Once that's fixed (after the release) we can enable it again.
2017-06-10tests: Increase dependencies coverage a bit moreNirbheek Chauhan1-1/+1
2017-06-09unit tests: Add class to generate failing testsNirbheek Chauhan1-13/+1
It is not feasible to test all failure modes by creating projects in `test cases/failing` that would be an explosion of files, and that mechanism is too coarse anyway. We have no way to ensure that the expected error is being raised. See FailureTests.test_dependency for an example.
2017-05-21Create helper function for a rmtree that works reliably on Windows.Jussi Pakkanen1-18/+5
2017-05-17Remove unused variables.Elliott Sales de Andrade1-1/+0
2017-05-17Remove unnecessary __init__ methods.Elliott Sales de Andrade1-3/+0
2017-05-13Skip ObjectiveC/C++ tests if ObjC compiler is not availableTim-Philipp Müller1-1/+21
2017-05-09project tests: Also regen before buildingNirbheek Chauhan1-3/+7
This actually caught a cached-dependency related bug for me that the test-time regen did not. I also increased the ninja wait time to 1 second because that's actually how long you need to sleep to be guaranteed that a change will be detected. Must poke upstream about https://github.com/ninja-build/ninja/issues/371
2017-05-05Store and print test logs of executed projects.Jussi Pakkanen1-2/+8
2017-05-02Don't use len() to test emptiness vs not emptinessDylan Baker1-2/+2
Meson has a common pattern of using 'if len(foo) == 0:' or 'if len(foo) != 0:', however, this is a common anti-pattern in python. Instead tests for emptiness/non-emptiness should be done with a simple 'if foo:' or 'if not foo:' Consider the following: >>> import timeit >>> timeit.timeit('if len([]) == 0: pass') 0.10730923599840025 >>> timeit.timeit('if not []: pass') 0.030033907998586074 >>> timeit.timeit('if len(['a', 'b', 'c', 'd']) == 0: pass') 0.1154778649979562 >>> timeit.timeit("if not ['a', 'b', 'c', 'd']: pass") 0.08259823200205574 >>> timeit.timeit('if len("") == 0: pass') 0.089759664999292 >>> timeit.timeit('if not "": pass') 0.02340641999762738 >>> timeit.timeit('if len("foo") == 0: pass') 0.08848102600313723 >>> timeit.timeit('if not "foo": pass') 0.04032287199879647 And for the one additional case of 'if len(foo.strip()) == 0', which can be replaced with 'if not foo.isspace()' >>> timeit.timeit('if len(" ".strip()) == 0: pass') 0.15294511600222904 >>> timeit.timeit('if " ".isspace(): pass') 0.09413968399894657 >>> timeit.timeit('if len(" abc".strip()) == 0: pass') 0.2023209120015963 >>> timeit.timeit('if " abc".isspace(): pass') 0.09571301700270851 In other words, it's always a win to not use len(), when you don't actually want to check the length.
2017-04-29Warn when directory numbers are non-unique.Elliott Sales de Andrade1-0/+7
2017-04-29Shorten detect_tests_to_run.Elliott Sales de Andrade1-21/+24
Remove some duplication with a list comprehension, and invert conditions instead of long ternary statements.
2017-04-09tests: Move appveyor platform workaround to run_tests.pyNirbheek Chauhan1-15/+0
This is also needed for the unit tests
2017-04-09unit tests: Fix running specific targets with MSBuildNirbheek Chauhan1-10/+13
/t:targetname syntax doesn't work, but running the vcxproj does work Also use the Backend enum everywhere.
2017-04-09run_project_tests: Clean on backends that can't installNirbheek Chauhan1-46/+34
Also sets more groundwork for running unit tests with backends other that Ninja. Transferring global state to executors is totally broken in Python 3.4 so just serialize all the commands.
2017-04-09project tests: Add a new BuildStep called validateNirbheek Chauhan1-1/+2
2017-04-09run_project_tests: Clean-up backend detection a bitNirbheek Chauhan1-36/+28
Set a global variable that has it so other places can use it, and error out on unknown backends
2017-04-09tests: Factor out common code to run_testsNirbheek Chauhan1-24/+13
And use generic build/clean/test/install commands in the unit tests, just like project tests. This sets the groundwork for running the unit tests with all backends.
2017-04-06Ignore missing .pdb files when not using MSVSJon Turney1-0/+3
This fixes 'test cases/windows/1 basic' on Cygwin
2017-04-06Don't run framework tests on CygwinJon Turney1-1/+1
2017-04-06Run test cases/windows/ tests on CygwinJon Turney1-1/+1
Also, always run 'test cases/windows/5 resources' on Cygwin since it can handle args containing spaces correctly.
generated by cgit v1.1 at 2024-11-16 10:10:02 +0000