[ocaml-platform] Is there a Travis check expert in the room?

[Thomas Gazagnaire]

> I suspect my needs are significantly more complex than this example has.

not really...

To get the diff file of your PR: 
https://github.com/ocaml/opam-repository/blob/master/.travis-ci.sh#L12

An example of a check that you can run on the PR file:
cat pullreq.diff | sed -E -n -e 's,\+\+\+ b/packages/[^/]*/([^/]*)/.*,\1,p' | sort -u > tobuild.txt
(https://github.com/ocaml/opam-repository/blob/master/.travis-ci.sh#L41)

And use the matrix thing to decide which test is optional or not.

> - I want to run several checks (on the same os whatever) implemented
> in several different bash scripts, one mandatory (the existing
> testsuite/ and stuff) and some optional (the new tests). The results
> should also be reported separately to the user.
> - I need to inspect the diff of the pull request being tested to check
> that Changes is modified (for one test) and at least a file in
> testsuite/ (for the other test), the scripts cannot be just programmed
> on the post-PR state of the index
> 
> I'm sure it is possible to read lots of documentation somewhere and
> learn how to do all this by myself, but I was suspecting that there
> may exist someone that already knows a bit of that and thus be much
> faster at doing it (or someone willing to learn and do it) on this
> list. I'm trying to *not do it myself*.

The hard part is not the integration with the CI. If you manage to write simple bash scripts which parse the output of `git log` (or whatever diff file that you provide), plugging that into the CI is very easy and I can help doing it.

Thomas


> 
> On Fri, Nov 20, 2015 at 1:44 PM, Thomas Gazagnaire
> <thomas at gazagnaire.org> wrote:
>> Hi Gabriel,
>> 
>> basically if you just have a bash script doing these checks (controlled by an environment variable), it's pretty easy to add them either as additional runs in Travis. See:
>> 
>> https://github.com/ocaml/opam-repository/blob/master/.travis.yml#L5-L25
>> 
>> I'm happy to help integrating these once you have the basic shell scripts running.
>> 
>> Thomas
>> 
>>> On 20 Nov 2015, at 13:17, Gabriel Scherer <gabriel.scherer at gmail.com> wrote:
>>> 
>>> Hi platform,
>>> 
>>> I would like to experiment with two new optional travis checks on the
>>> ocaml/ocaml repository, to verify that pull requests come with some
>>> tests and a Changes entry. I created an issue to track this need at:
>>> http://caml.inria.fr/mantis/view.php?id=7052
>>> 
>>> This is not higher priority but if there was a Travis check expert
>>> around here, a pull request to do this would be much appreciated.
>>> 
>>> (It may turn out that there are too many cases where these tests fail
>>> for a good reason and we later decide to disable them. I do suspect
>>> they would have a positive net effect, though.)
>>> 
>>> Thanks!
>>> _______________________________________________
>>> Platform mailing list
>>> Platform at lists.ocaml.org
>>> http://lists.ocaml.org/listinfo/platform
>>