• View
• Edit
• History
• Print

HLA

This page is no longer maintained, see https://www.icyphy.org/hla/wiki/Main/HomePage

Internal Resources

• High-Level Architecture (HLA) (iCyPhy members only)

Notes

HLA Test Case Failure

• See High-Level Architecture (HLA) (iCyPhy members only) for some email.

The test has been failing for some time on sisyphus.

Running the test under Mac OS passes some times.

If rtig is not running, then I get:

It turns out that there were two errors

1. The HLATest.tcl was creating listeners inside a Tcl function, and the listeners were getting gc'd and the results from listening to the Manager was differing between runs. The fix is to add the listeners to a list so that they don't get gc'd.
2. CertiRtig was setting LD_LIBRARY_PATH to just the certi lib directory, but the rtig binary needs libraries from other directories.

Building CERTI on the Mac

1/30/2015

See ptolemy/apps/hlacerti/INSTALL_CERTI.txt:

Problems building CERTI-3.4.2 on the Mac

Problem: implicit instantiation of undefined template 'std::auto_ptr<rti1516::LogicalTime>'

make -n indicates we are running /usr/bin/c++ which is Apple LLVM version 6.0 (clang-600.0.56) (based on LLVM 3.5svn)

Solution: As root:

 cd /opt/local/bin ln -s g++-mp-4.9 c++

CERTI-3.4.2: fatal error: X11/bitmaps/cntr_ptr: No such file or directory

Solution: As root port install bitmap

rtig: Bind Address already in use

Solution: Use ps to find the other rtig process and kill it.

Or

 export CERTI_UDP_PORT=1235
 export CERTI_TCP_PORT=1237
 export CERTI_HOST=127.0.0.1
 rtig -l 127.0.0.1

FIXME: The CERTI code should prompt the user to use -l if there is an error.

Running the Billiard demo

 rtig &

In two separate windows:

 billard -f Test.fed -F Test.xml -n1 

and

 billard -f Test.fed -F Test.xml -n2

An X11 window should appear.

Problems under El Capitan

After installing Ptolemy and CERTI in El Captain using the instructions in $PTII/ptolemy/apps/hlacerti/manual-ptii-hla.pdf

the demos using HLA/CERTI in $PTII/ptolemy/apps/hlacerti/demo (e.g., Billard/FederationBillard.xml) do not work:

• Ptolemy models are stuck with the message "initializing." in the left bottom corner,
• In the terminal where Ptolemy was launched appears the message:

For other errors, please read section Appendix B (Error messages) of $PTII/ptolemy/apps/hlacerti/manual-ptii-hla.pdf.

What was happening was that running the model as a non-root user was failing, but running the model as root would work.

Even more interestingly, if the rtig process was run as a non-root user, then running the model as root would work, but as non-root would not. This probably has to do with SIP (details below).

How to install CERTI under El Capitan:

1. See $PTII/ptolemy/apps/hlacerti/manual-ptii-hla.pdf and do a clean install of CERTI in ~/pthla
2. As root, create links in /usr/local/lib as indicated in $PTII/ptolemy/apps/hlacerti/manual-ptii-hla.pdf:
   bash-3.2$ pwd
   /Users/cxh/pthla/certi/build-certi
   bash-3.2$ sudo -i
   Password:
   ealmac23:~ root# whoami
   root
   ealmac23:~ root# cd /usr/local/lib
   ealmac23:~ root# ln -s /Users/cxh/pthla/certi-tools/lib/* .
   ealmac23:lib root# exit
   logout
   bash-3.2$ whoami
   cxh
   bash-3.2$

   [$[Get Code]]
3. As your regular, non-root user, set the variables:
   source ~/pthla/certi-tools/share/scripts/myCERTI_env.sh

   [$[Get Code]]
4. Run the model:
   export $PTII=~/ptII
   $PTII/bin/vergil $PTII/org/hlacerti/demo/Billard/Billard.xml
   

   [$[Get Code]]

If there are problems running the Ptolemy HLA demos under El Capitan

1. Try running rtig by hand on the .fed file:
   bash-3.2$ which rtig
   /Users/cxh/pthla/certi-tools/bin/rtig
   bash-3.2$ rtig $PTII/org/hlacerti/demo/Billard/Test.fed
   CERTI RTIG 3.5.1 - Copyright 2002-2008  ONERA
   This is free software ; see the source for copying conditions. There is NO
   warranty ; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
   
   CERTI RTIG up and running ...

   [$[Get Code]]
   1. If rtig does not start up from the shell, then the myCERTI_env.sh was either not sourced properly or there are other problems
2. Ptolemy is a Java process that invokes /bin/sh -c so that it can set DY_LD_LIBRARY_PATH. This probably does not do much under El Capitan, but it will help other versions of Mac OS and Linux. Run the Ptolemy model
   bash-3.2$ $PTII/bin/vergil $PTII/org/hlacerti/demo/Billard/Billard.xml
   CertRtig: the os.name property is: Mac OS X
   CertiRtig: .TwoBilliardBalls.HlaManager: About to invoke rtig:
   command: [/bin/sh, -c, /Users/cxh/pthla/certi-tools/bin/rtig, Test.fed]
   environment: [DYLD_LIBRARY_PATH=/Users/cxh/pthla/certi-tools/lib]
   directory: /Users/cxh/ptII/org/hlacerti/demo/Billard
   CertRtig: the os.name property is: Mac OS X
   CertiRtig: .PoolTable2.display: About to invoke rtig:
   command: [/bin/sh, -c, /Users/cxh/pthla/certi-tools/bin/rtig, Test.fed]
   environment: [DYLD_LIBRARY_PATH=/Users/cxh/pthla/certi-tools/lib]
   directory: /Users/cxh/ptII/org/hlacerti/demo/Billard
   CertiRtig: .PoolTable2.display: About to terminate rtig.
   7610 ms. Memory: 274944K Free: 88462K (32%)
   6493 ms. Memory: 274944K Free: 88462K (32%)
   7864 ms. Memory: 274944K Free: 86122K (31%)

   [$[Get Code]]
   1. If there are problems: /Applications/Utilities/Console, then run the model as non-root and look for new errors.
   2. Or, as a different user (I used root), source the myCERTI_env.sh script and try running the model.

Notes about various efforts to get CERTI to work under El Capitan

Below are notes about various things that were tried.

System Integrity Protection (SIP)

System Integrity Protection (SIP) was introduced in El Capitan in an effort to increase the security of the Mac OS.

Summary: To get CERTI to work, links need to be made for the shared libraries. It could be that installing CERTI in /usr/local would do the trick, see https://support.apple.com/en-us/HT204899:

"Paths and applications that third-party apps and installers can write to include:

• /Applications
• /Library
• /usr/local

"

BTW - For one user, the problem was not just SIP, but I also had multiple versions of CERTI installed.

• El Capitan and DY_LD_LIBRARY_PATH - DY_LD_LIBRARY_PATH is ignored. This turned out to not be the entire issue

One way to check is to run:

Then start the model.

Then check for rtig processes:

Note that the rtig processes is running for me.

Also, we can use telnet to connect to port 60400:

The fact that there is a process at port 60400 indicates that the process is running and that SIP is not totally blocking execution.

As root, running the demo works:

On a machine where SIP is Enabled (to check reboot, hold Command-R, run csrutil status. See How to modify system integrity protection in El Capitan.)

The results:

However, running not as root with the above commands fails, the Ptolemy stack trace is:

As non-root, the rtig binary starts up:

Note that otool -L lists the shared libraries:

So, the problem is running Java and then trying to run rtig

Starting $PTII/bin/vergil $PTII/org/hlacerti/demo/Billard/Billard.xml as a non-root user shows these libraries are in the the java.library.path JDK property:

  java.library.path = /Users/cxh/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.:/Users/cxh/ptII/lib

Note that the value of $DYLD_LIBRARY_PATH is ignored, but that /Users/cxh/ptII/lib is searched. That's because we set that property for Matlab.

Running rtig as non-root and Ptolemy as root works

However, it seems that running rtig from the command line as non-root works, if the Java process as run as root.

To replicate:

Edit org/hlacerti/lib/CertiRtig.java and in _read() have hit print out the value of _stringBuffer, then recompile.

As non-root:

As root:

Note that root tries to start up rtig, but it is already running.

Recompiling JCERTI

1. Download: git clone git://git.savannah.nongnu.org/certi/jcerti.git
2. cd jcerti
3. Edit build.xml and enable debugging in the javac command:
                   <javac srcdir="${src.dir}" includeantruntime="false" destdir="${class.dir}" target="1.5" source="1.5" deprecation="on" debug="on">

   [$[Get Code]]
4. Run ant
5. Copy the jar file: cp ./build/jar/jcerti.jar $PTII/lib/jcerti.jar
6. Run the model: $PTII/bin/vergil $PTII/org/hlacerti/demo/Billard/Billard.xml

Debugging JCERTI

1. Edit jcerti/src/certi/communication/MessageBuffer.java:
       public String toString() {
           return super.toString() + "size: " + buffer.size();
       }

   [$[Get Code]]
2. Edit jcerti/src/certi/communication/MessageFactory.java and add a println:
       public static CertiMessage readMessage(MessageBuffer messageBuffer) throws IOException, CertiException {
           messageBuffer.receiveData();
   
           System.out.println("MessageFactory.readMessage(): " + messageBuffer);
           CertiMessage message = instantiate(CertiMessageType.reverseType.get(mes\
   sageBuffer.readInt())); //read first integer from header and instantiate class  
   
           message.readMessage(messageBuffer);
   
           return message;
       }

   [$[Get Code]]
3. Edit jcerti/src/certi/rti/impl/CertiRtiAmbassador.java and print the stack trace:
           ////////////////////                                                    
           // Open connexion //                                                    
           ////////////////////                                                    
           try {
               OpenConnexion openConnexion = new OpenConnexion();
               openConnexion.setVersionMinor(0);
               openConnexion.setVersionMajor(1);
               OpenConnexion response = (OpenConnexion) processRequest(openConnexion);
           } catch (Exception exception) {
               exception.printStackTrace();
               throw new RTIinternalError("Connection to RTIA failed. " + exception.getLocalizedMessage() + "exception was: " + exception);
           }

   [$[Get Code]]
4. Edit jcerti/src/certi/rti/impl/CertiRtiAmbassador.java and print the message being sent:
           CertiMessage response = null;
           synchronized(this.messageBuffer) {
               request.writeMessage(this.messageBuffer);
   
               System.out.println("CertiRtiAmbassador.processRequest(): sending: " + request);
   
               try {
                   LOGGER.info("Sending message (" + request.toString() + ")");
                   this.messageBuffer.send();
               } catch (IOException ex) {
                   LOGGER.severe("libRTI: exception: NetworkError (write)");
                   throw new RTIinternalError("libRTI: Network Write Error");
               }
   
               try {
                   response = MessageFactory.readMessage(messageBuffer);
   
   
                   LOGGER.info("Received message (" + response.toString() + ")\n");
   
                   if (request.getType() != (response.getType())) {
                       throw new RTIinternalError("RTI Ambassador Process request: request type != response type");
                   }
               } catch (IOException ex) {
                   LOGGER.severe("libRTI: exception: NetworkError (read)");
                   throw new RTIinternalError("libRTI: Network Read Error");

   [$[Get Code]]
5. Run ant
6. Copy the jar file: cp ./build/jar/jcerti.jar $PTII/lib/jcerti.jar
7. Run the model: $PTII/bin/vergil $PTII/org/hlacerti/demo/Billard/Billard.xml

It looks like this message is getting sent:

   CertiRtiAmbassador.processRequest(): sending: OPEN_CONNEXION, NO_EXCEPTION, federation time: null, versionMajor: 1, versionMinor: 0

And no message is being received:

    MessageFactory.readMessage(): certi.communication.MessageBuffer@6711fccbsize: 0

Sockets in RAW Mode?

It could be that we are opening sockets in RAW mode, which probably only works for root. It turns out that this probably not the case. I'm guessing that the issue was with the environment of my account and accidentally having a slightly different version of CERTI in my path

Can someone elaborate on the OS X 10.11 feature called 'Rootless'? says:

"The list of programs is really, really long. Anything that accesses /dev/mem or /dev/kmem or some other devices. Anything that opens sockets in RAW mode"

Possible Solution

Looking at the console and then running vergil, I saw:

  5/10/16 4:13:14.677 PM ReportCrash[2218]: Saved crash report for rtia[2217] version 0 to /Users/cxh/Library/Logs/DiagnosticReports/rtia_2016-05-10-161314_ealmac23.crash

Clicking on the report:

It looks like I had another copy of rtia and rtig:

My solution was to remove /usr/local/certi-3.4.3

Then, the model worked as non-root!

getHostByName() returns Null

See CERTI gethostbyname