AT-TPC Wiki

CoBo: Concentration Board for the GET (General electronics for TPC) electronics to reduce high data throughput of Time Projection Chamber detectors.

CoBo interfaces with three major components:

1. Asad (ASIC-ADC) board via 68-pin VHDCI cables. Asad hosts the AGET chip.
2. Mutant (MUltiplicity Trigger ANd Time) board via MicroTCA backplane: CLK2, CLK3, PORT1, and PORTS<8:11>.
3. Controller and storage farm via GbE connections.

CoBo is μTCA compatible. i.e. PICMG® AMC.0 R1.0. and is hosted in MicroTCA chassis (VadaTech VT893). The chassis is capable of hosting 11 CoBo cards. However, in AT-TPC we will only utilize 10 cards. Each CoBo card is connected to 4 Asad boards and each Asad board is connected to 256 (channels) sensors in the detector. Therefore, the entire system is capable of processing 10240 channels.

CoBo hardware, firmware, and software is developed at NSCL. The generic embedded software for AGET chip is developed by IRFU (CEA) and is used on Mutant, CoBo, and PC farm.

Responsibilities:

• NSCL:

1. Xilinx ML507 test platform and daughter board for CoBo (Nathan Usher)
2. CoBo PCB design, implementation, and testing (Faisal T. Abu-Nimeh)
3. Firmware:
   • CoBo_Control and CoBo_Data IPs (Nathan Usher)
   • PLL IP (Faisal T. Abu-Nimeh)
   • System Architecture (CPU, Memory, Ethernet, etc) (Faisal T. Abu-Nimeh)
4. Embedded Software: development and testing (Faisal T. Abu-Nimeh)
5. MicroTCA development (based on VT028) (Faisal T. Abu-Nimeh)

• IRFU:

1. VxWorks GET Embedded Software (Patrick Sizun and Shebli Anvar)
   1. NSCL quick installation for GET software

A simplified depiction of the GET system is shown in the figure. A time project chamber hosting a 10240-pad MicroMega is connected to a smart protection board then fed to the AGET chips hosted on the Asad board. Every CoBo is then connected to 4 Asad boards using 4 dedicated VHDCI connectors on the front panel. The processed data is passed down to the Mutant as well as sent out using GbE to the storage farm.

1. Locate an empty slot in the MicroTCA crate.
2. Remove any other AMC cards in the crate to make sure there is no conflicts on the backplane.
3. Make sure that the MCH (UTC002) is plugged in, and the Power Supply (UTC010) is plugged in.
4. Connect Xilinx USB JTAG to CoBo
5. Insert cobo to any slot you desire.
6. Switch on the crate. after a while a green LED should light up on CoBo in the upper right corner i.e. top. Since you are using a socket, Asad status LEDS might come on. you can ignore these for now.
7. If the board is ready, the LED on the JTAG connector should be green not amber. If it is amber then the cobo is not powered up.
8. Connect the MCH port GbE0 or GbE1 to your network. This has to be a local network. If you are using VadaTech the IP should be 192.168.40.xxx
9. You should have a DHCP server and a NFS server running in that subnet. See (Setup) and (Setup).

• 1. NFS should be exporting the embedded software that will run on CoBo-VxWorks. e.g. getHwServer-release-20130829.out
  2. in /mnt/local/export/filesystem create a file called startup.vxsh and insert the getHwServer out file in it e.g.

     ld < getHwServer-release-20130829.out

1. Look at at :cobo_fp.pptx, you must short L2 and L3 LEMO connectors. This will not be needed in the future. The FPGA sends a sync plus to PLL to allow it to start.
2. L0 connector should be connected to an oscilloscope.
3. Connect a mini-usb cable from your workstation to cobo. on windows you will need a driver. I didn't need one for ubuntu 12.04 nor fedora 19. The driver can be installed from silicon labs the chip is cp21xx, open a terminal using putty or screen with the same settigns you use for ML507 cobo. i.e. 115200
4. On your workstation start xmd. Take a look at XMD setup for Linux xmd setup info.
5. Once you are in xmd flash the FPGA by typing fpga -f system.bit
6. If the FPGA is flashed successfully a blue LED should light up. this is inside the crate not on the front panel. The led is located above the fpga.

   $ xmd
   Xilinx Microprocessor Debugger (XMD) Engine Xilinx EDK 14.5 Build EDK_P.58f Copyright (c) 1995-2012 Xilinx, Inc.  All rights reserved.
   
   XMD%
   
   JTAG chain configuration
   --------------------------------------------------
   Device   ID Code        IR Length    Part Name
    1       232d8093          14        XC5VFX100T
   ERROR: PowerPC405 Version UNKNOWN. The PowerPC405 Config String is NOT Valid
                   : 0xffffffff
   
   XMD% fpga -f system.bit
   Programming Bitstream -- system.bit
   Fpga Programming Progress ......10....20....30....40....50....60....70....80....90.....Done
   Successfully downloaded bit file.
   
   JTAG chain configuration
   --------------------------------------------------
   Device   ID Code        IR Length    Part Name
    1       232d8093          14        XC5VFX100T
   
   0
   XMD% connect ppc hw
   
   JTAG chain configuration
   --------------------------------------------------
   Device   ID Code        IR Length    Part Name
    1       232d8093          14        XC5VFX100T
   
   PowerPC440 Processor Configuration
   -------------------------------------
   Version.............................0x7ff21912
   User ID.............................0x00f00002
   No of PC Breakpoints................4
   No of Addr/Data Watchpoints.........2
   User Defined Address Map to access Special PowerPC Features using XMD:
                   I-Cache (Data)........0x70000000 - 0x70007fff
                   I-Cache (TAG).........0x70008000 - 0x7000ffff
                   D-Cache               (Data)........0x78000000 - 0x78007fff
                   D-Cache               (TAG).........0x78008000 - 0x7800ffff
                   DCR...................0x78020000 - 0x78020fff
                   TLB...................0x70020000 - 0x70023fff
   
   Connected to "ppc" target. id = 32
   Starting GDB server for "ppc" target (id = 32) at TCP port no 1234 XMD%

7. to run cobo in standalone mode you need to start the clocks. go to xmd and type dow coboTest.elf
8. now type run
9. cobotest should run on CoBo. Look at putty or screen. You should see a menu. press 5 to load default PLL settings.
10. on the oscilliscpe connected to L0 you should see a dirty 100Mhz clock. This is normal. If you don't see a clock then the fpga is not flashed.
11. on xmd type stop
12. now you can download vxworks by typing (in xmd) the following dow vx4.elf
13. now type run
14. vxworks should load on the console and get an IP thru the MCH thru your DHCP server.

1. Turn on MicroTCA crate
2. open USB-Serial terminal e.g. putty
3. load FW thru xmd fpga -f system.bit
4. load PLL config thru xmd dow coboTest.elf then run
5. in usb-serial terminal choose option 5 to load PLL options. take a look at oscilloscope, You should see a clock.
6. stop cpu thru xmd stop
7. load vxworks image thru xmd dow vx4.elf then run
8. take a loko at usb-serial terminal, CoBo should get an IP. Start using GetController