• View
• Edit
• History
• Print

Jenkins

Sisyphus had Hudson.

Terratest has Jenkins

Installation on Terratest

• Installing Jenkins on RedHat Distributions

As root:

  sudo wget -O /etc/yum.repos.d/jenkins.repo http://pkg.jenkins-ci.org/redhat/jenkins.repo
  sudo rpm --import http://pkg.jenkins-ci.org/redhat/jenkins-ci.org.key
  yum install jenkins
  sudo service jenkins start

Open up port 80, 443 and 8080 on terratest. As root, I ran system-config-firewall, which worked in a terminal and opened up the ports. /sbin/iptables -L should include something like:

Set up security

1. http://terra.eecs.berkeley.edu:8080/configureSecurity
2. Security Realm -> Jenkins’ own user database
3. Authorization -> Matrix-based security
4. User/group to add:
5. Click on the far right icon to enable all the perms

Email on moog

Moog handles the email. Moog needs to be told to relay the email.

1. Edit /etc/mail/local-host-names and add the host
2. kill -1 sendmail

Also, send email to addresses hosted on moog like @moog.eecs, not @eecs so that moog handles the email.

Git

The configuration panel says:

  Failed to connect to repository : Command "git -c core.askpass=true ls-remote -h https://github.com/cxbrooks/fmusdk2.git HEAD" returned status code 129:
  stdout:
  stderr: Unknown option: -c
  usage: git [--version] [--exec-path[=GIT_EXEC_PATH]] [--html-path]
           [-p|--paginate|--no-pager] [--no-replace-objects]
           [--bare] [--git-dir=GIT_DIR] [--work-tree=GIT_WORK_TREE]
           [--help] COMMAND [ARGS]

The log says:

  Started by user Christopher Brooks
  Building in workspace /var/lib/jenkins/workspace/fmusdk2
   > /usr/local/git/bin/git rev-parse --is-inside-work-tree # timeout=10
  Fetching changes from the remote Git repository
   > /usr/local/git/bin/git config remote.origin.url https://github.com/cxbrooks/fmusdk2.git # timeout=10
  Fetching upstream changes from https://github.com/cxbrooks/fmusdk2.git
   > /usr/local/git/bin/git --version # timeout=10
   > /usr/local/git/bin/git -c core.askpass=true fetch --tags --progress https://github.com/cxbrooks/fmusdk2.git +refs/heads/*:refs/remotes/origin/*
  ERROR: Error fetching remote repo 'origin'
  ERROR: Error fetching remote repo 'origin'
  Sending e-mails to: cxh@eecs.berkeley.edu
  Finished: FAILURE

/usr/local/git/bin/git is

  bash-4.1$ /usr/local/git/bin/git --version
  git version 2.2.1

Hmm, git itself is having problems:

  bash-4.1$ git clone https://github.com/cxbrooks/fmusdk2.git 
  Cloning into 'fmusdk2'...
  fatal: Unable to find remote helper for 'https'

Solution: git clone: fatal: Unable to find remote helper for 'https': Install curl devel: yum install curl-devel, reconfigure git and reinstall.

Curl Under Jenkins

Under Jenkins, running git clone by hand was yielding:

  bash-4.1$ git clone https://repo.eecs.berkeley.edu/git/xxx/yyy.git
  Cloning into 'gdp'...
  fatal: unable to access 'https://repo.eecs.berkeley.edu/git/xxx/yyy.git/': Protocol https not supported or disabled in libcurl

The problem here is that jenkins needs to have matlab in the path first for the ptII build, so the fix of:

  export LD_LIBRARY_PATH=/usr/lib64:${LD_LIBRARY_PATH}

will not work.

My workaround was to configure Jenkins: "Prepare an environment for the run" -> "Properties Content":

  LD_LIBRARY_PATH=/usr/lib64:$LD_LIBRARY_PATH

Get PMD to Ignore Directories

We are running PMD's CPD to look for duplicate C code. I want it to ignore the node_modules directories.

To do this, I edited pmd-src-5.2.3/pmd-core/src/main/java/net/sourceforge/pmd/cpd/CPDConfiguration.java, see the FIXMEs in two places:

Here's the script we use in Jenkins to do code coverage:

Jenkins hanging while parsing the output from the JavaDoc Tool

I upgraded to jdk1.8.0_45, the builds ran successfully once and then started to hang.

The build from Apr 21 11:53 worked as did the one from Apr 22 04:49.

However, two builds on Apr 23 did not work

Using jstack on the java pid yields:

The error could have been because one directory did not have java files in it?

Upgrading was probably the real fix.

5/19/2015- The nightly build hung again. jstack said:

And

      [junit] javadoc: warning - No source files for package ptolemy.domains.wireless.bluetooth

and

    [junit] Constructing Javadoc information...
    [junit] javadoc: warning - No source files for package org.terraswarm.gdp
    [junit] javadoc: warning - No source files for package org.terraswarm.gdp.apps
    [junit] javadoc: warning - No source files for package ptolemy.actor.lib.modules.jjs
    [junit] Registered Taglet doc.doclets.RatingTaglet ..

I'll try fixing those errors and see what happens.