Project

General

Profile

Actions

Action Item #511

closed

Port PiBox to Raspberry Pi 2

Added by Hammel about 8 years ago. Updated over 7 years ago.

Status:
Closed
Priority:
Immediate
Assignee:
Category:
00 - Basic Build Issues
Target version:
Start date:
19 Mar 2016
Due date:
% Done:

100%

Estimated time:
Severity:
01 - Critical

Description

This is a matter of:
  1. Updating xcc to build for the new hardware
  2. Updating firmware configurations
  3. Building the kernel to support hardware changes where necessary
  4. Updating the root file system if necessary

Danny needs this to work on the Pi2's he bought. I had it working but didn't check it in. So now I need to create a branch for it to test the changes before merging with master.


Related issues

Related to PiBox - Testing #460: Review BananaPi as replacement for RaspberryPiIn ProgressHammel24 Jul 2015

Actions
Actions #1

Updated by Hammel about 8 years ago

  • Status changed from New to In Progress
  • % Done changed from 0 to 10

I just created the mjhammel/rpi2 branch for the pibox repo. This has the new xcc configurations on it.

Next I'll probably have to fix the firmware targets to copy all firmware to the DOS partition, as noted in RM #460.

Actions #2

Updated by Hammel about 8 years ago

  • % Done changed from 10 to 20

I pushed the change to grab all the firmware with rpifw-pkg target. It's in the mjhammel/rpi2 branch.

Haven't tested it yet.

Actions #3

Updated by Hammel almost 8 years ago

  • % Done changed from 20 to 50

I rebuilt today, just to get started again. The rebuild exposed bugs in libpibox and pnc builds which are now fixed. Both the rpi (galileo) and rpi2 (feynman) builds have completed and are ready for testing.

The rpi2 build in the mjhammel/rpi2 branch.

The rpi build is in master.

I need to
  1. Run metabuild on CentOS to get packages for the media server
  2. generate the rpi2 image on CentOS
  3. install and test on an rpi2 board

I also need to test the images on an rpi to make sure it's still working correctly.

Actions #4

Updated by Hammel almost 8 years ago

Ran metabuild on Fedora and CentOS. It failed in both places.

On Fedora it looks like this:

/opt/rpiTC/bin/arm-unknown-linux-gnueabi-g++ 
 --sysroot=/opt/rpiTC/arm-unknown-linux-gnueabi/sysroot -mfloat-abi=hard \
 -mcpu=arm1176jzf-s -fomit-frame-pointer -mabi=aapcs-linux -mtune=arm1176jzf-s \
 -mfpu=vfp -Wno-psabi -mno-apcs-stack-check -O3 -mstructure-size-boundary=32 \
 -mno-sched-prolog -march=armv6zk -std=c++0x -D__STDC_CONSTANT_MACROS \
 -D__STDC_LIMIT_MACROS -DTARGET_POSIX -DTARGET_LINUX -fPIC -DPIC -D_REENTRANT \
 -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64 -DHAVE_CMAKE_CONFIG \
 -D__VIDEOCORE4__ -U_FORTIFY_SOURCE -Wall -DHAVE_OMXLIB -DUSE_EXTERNAL_FFMPEG \
 -DHAVE_LIBAVCODEC_AVCODEC_H -DHAVE_LIBAVUTIL_OPT_H -DHAVE_LIBAVUTIL_MEM_H \
 -DHAVE_LIBAVUTIL_AVUTIL_H -DHAVE_LIBAVFORMAT_AVFORMAT_H \
 -DHAVE_LIBAVFILTER_AVFILTER_H -DHAVE_LIBSWRESAMPLE_SWRESAMPLE_H -DOMX \
 -DOMX_SKIP64BIT -ftree-vectorize -DUSE_EXTERNAL_OMX -DTARGET_RASPBERRY_PI \
 -DUSE_EXTERNAL_LIBBCM_HOST \
 -I/opt/rpiTC/arm-unknown-linux-gnueabi/sysroot/usr/include \
 -I/home/mjhammel/src/ximba/raspberrypi/bld/buildroot-2015.02/output/target/opt/vc/include \
 -I/home/mjhammel/src/ximba/raspberrypi/bld/buildroot-2015.02/output/target/opt/vc/include/interface/vcos/pthreads \
 -I/home/mjhammel/src/ximba/raspberrypi/bld/buildroot-2015.02/output/target/opt/vc/include/interface/vmcs_host \
 -I/home/mjhammel/src/ximba/raspberrypi/bld/buildroot-2015.02/output/staging/usr/lib/dbus-1.0/include \
 -isystem/home/mjhammel/src/ximba/raspberrypi/bld/buildroot-2015.02/output/staging/usr/include \
 -isystem/home/mjhammel/src/ximba/raspberrypi/bld/buildroot-2015.02/output/staging/usr/include/freetype2 \
 -I./ -Ilinux -Iffmpeg_compiled/usr/local/include/ -I /usr/include/dbus-1.0 -I \
 /usr/lib/arm-linux-gnueabihf/dbus-1.0/include -c utils/log.cpp -o utils/log.o \
 -Wno-deprecated-declarations
In file included from /opt/rpiTC/arm-unknown-linux-gnueabi/include/c++/4.8.5/random:38:0,
                 from /opt/rpiTC/arm-unknown-linux-gnueabi/include/c++/4.8.5/bits/stl_algo.h:65,
                 from /opt/rpiTC/arm-unknown-linux-gnueabi/include/c++/4.8.5/algorithm:62,
                 from ./utils/StdString.h:667,
                 from utils/log.cpp:26:
/opt/rpiTC/arm-unknown-linux-gnueabi/include/c++/4.8.5/cmath:1043:11: error: '::acoshl' has not been declared
   using ::acoshl;
           ^     
/opt/rpiTC/arm-unknown-linux-gnueabi/include/c++/4.8.5/cmath:1047:11: error: '::asinhl' has not been declared
   using ::asinhl;

On CentOS is looks like this:

/opt/rpiTC/bin/arm-unknown-linux-gnueabi-g++ 
 --sysroot=/opt/rpiTC/arm-unknown-linux-gnueabi/sysroot -mfloat-abi=hard \
 -mcpu=arm1176jzf-s -fomit-frame-pointer -mabi=aapcs-linux -mtune=arm1176jzf-s \
 -mfpu=vfp -Wno-psabi -mno-apcs-stack-check -O3 -mstructure-size-boundary=32 \
 -mno-sched-prolog -march=armv6zk -std=c++0x -D__STDC_CONSTANT_MACROS \
 -D__STDC_LIMIT_MACROS -DTARGET_POSIX -DTARGET_LINUX -fPIC -DPIC -D_REENTRANT \
 -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64 -DHAVE_CMAKE_CONFIG \
 -D__VIDEOCORE4__ -U_FORTIFY_SOURCE -Wall -DHAVE_OMXLIB -DUSE_EXTERNAL_FFMPEG \
 -DHAVE_LIBAVCODEC_AVCODEC_H -DHAVE_LIBAVUTIL_OPT_H -DHAVE_LIBAVUTIL_MEM_H \
 -DHAVE_LIBAVUTIL_AVUTIL_H -DHAVE_LIBAVFORMAT_AVFORMAT_H \
 -DHAVE_LIBAVFILTER_AVFILTER_H -DHAVE_LIBSWRESAMPLE_SWRESAMPLE_H -DOMX \
 -DOMX_SKIP64BIT -ftree-vectorize -DUSE_EXTERNAL_OMX -DTARGET_RASPBERRY_PI \
 -DUSE_EXTERNAL_LIBBCM_HOST \
 -I/opt/rpiTC/arm-unknown-linux-gnueabi/sysroot/usr/include \
 -I/home/mjhammel/src/ximba/raspberrypi2/bld/buildroot-2015.02/output/target/opt/vc/include \
 -I/home/mjhammel/src/ximba/raspberrypi2/bld/buildroot-2015.02/output/target/opt/vc/include/interface/vcos/pthreads \
 -I/home/mjhammel/src/ximba/raspberrypi2/bld/buildroot-2015.02/output/target/opt/vc/include/interface/vmcs_host \
 -I/home/mjhammel/src/ximba/raspberrypi2/bld/buildroot-2015.02/output/staging/usr/lib/dbus-1.0/include \
 -isystem/home/mjhammel/src/ximba/raspberrypi2/bld/buildroot-2015.02/output/staging/usr/include \
 -isystem/home/mjhammel/src/ximba/raspberrypi2/bld/buildroot-2015.02/output/staging/usr/include/freetype2 \
 -I./ -Ilinux -Iffmpeg_compiled/usr/local/include/ -I /usr/include/dbus-1.0 -I \
 /usr/lib/arm-linux-gnueabihf/dbus-1.0/include -c BitstreamConverter.cpp -o \
 BitstreamConverter.o -Wno-deprecated-declarations
In file included from DllAvFormat.h:27:0,
                 from BitstreamConverter.h:27,
                 from BitstreamConverter.cpp:26:
DllAvCodec.h:79:64: error: 'PixelFormat' has not been declared
   virtual int avpicture_fill(AVPicture *picture, uint8_t *ptr, PixelFormat pix_fmt, int width, int height)=0;

Actions #5

Updated by Hammel almost 8 years ago

I think the Fedora one is a mixture of headers from host and target. If so, that may also be the problem on the CentOS box.

Actions #6

Updated by Hammel almost 8 years ago

  • % Done changed from 50 to 60

Found the problem: I was mixing toolchains and staging trees. I found when I built on Fedora by specifying XI= and SD= that omxplayer built correctly with the master branch of PiBox. However, after some testing I found that /opt/rpiTC is not the original and may be the rpi2 toolchain. So it's fubar. Similar problem on CentOS. I also found that the oxmplayer configs were incorrectly forcing the use of /opt/rpiTC and that broke the build if the wrong staging tree was specified too.

So I fixed omxplayer on fedora to work with the master branch build of PiBox. Now I'm building the rpi2 branch from scratch (after merging with master) on both Fedora and CentOS. I'm finding minor problems in the build, like expired packages. But once these complete I can retry omxplayer with rpi2 on both distros.

Actions #7

Updated by Hammel almost 8 years ago

  • % Done changed from 60 to 80

Fixed dev platform build (pibox repo) and metabuild. The latter required updates to the cross.sh script in various app repos, along with specifying env vars on make command lines for other app repos.

The fedora build is complete, both disk image and app opkgs, and ready for testing on an RPi2. The CentOS omxplayer build still fails, but for a different reason now:

In file included from DllAvFormat.h:27:0,
                 from BitstreamConverter.h:27,
                 from BitstreamConverter.cpp:26:
DllAvCodec.h:79:64: error: 'PixelFormat' has not been declared
   virtual int avpicture_fill(AVPicture *picture, uint8_t *ptr, PixelFormat pix_fmt, int width, int height)=0;
                                                                ^
DllAvCodec.h:84:34: error: 'PixelFormat' has not been declared
   virtual int avpicture_get_size(PixelFormat pix_fmt, int width, int height)=0;
                                  ^
DllAvCodec.h:101:51: error: 'PixelFormat' has not been declared
   virtual int avpicture_alloc(AVPicture *picture, PixelFormat pix_fmt, int width, int height)=0;

It's unclear what this problem is. The two builds should be using the same headers and toolchains.

Actions #8

Updated by Hammel almost 8 years ago

Test boot on RPi2

Basically it worked if I used the prebuilt kernel provided in the firmware release. However....

  1. Firmware build doesn't copy all necessary files, I think. Just copy all files and then remove the prebuilt kernels.
  2. PiBox kernel is built incorrectly so doesn't boot. I need to use bcm2709_defconfig for RPi 2 and RPi 3.
  3. Kernel name will need to be kernel7.img, not kernel.img.
  4. Copy kernel in after copying in firmware.
  5. Audio doesn't play out of the combined audio/mic port. (audio plays fine through HDMI, which is the use case for the server but not the player).
  6. GLES build (pibox.cmake) has hard coded values for RPi 1 arch. This needs to be configured with tags so glex.mk can set replace the tags with the appropriate architecture based on the HW setting of the build.

That's it for now. I noticed that, when using the prebuilt kernel, that the stability of the system was suspect. psplash, for one, doesn't seem to work at all. I can just remove that one or make sure it's building against the right kernel perhaps.

The Media Player UI doesn't work correctly with a USB cabled keyboard but that is probably completely unrelated to this port. I'll have to try with a FAVI keyboard to be certain.

Actions #9

Updated by Hammel almost 8 years ago

My kernel boots and the system basically worked. However, I'm back to the "X.org keyboard doesn't work" problem. I still have S01Xearly and S98Xearly to run X once and then S99UI to start it a second time, which works on the original RPi B+. After some experimentation I found that moving S99UI to inittab runs as "wait" after all sysinit complete works correctly, allowing the keyboard to work again.

I still have a couple of other problems however.
  1. Keyboard navigation in videofe doesn't work for wired USB or FAVI keyboards. The ESC and Enter keys work, however. Sounds like a keymap problem.
    1. Fixed: set focus and default for view widget in videofe app.
  2. Exiting omxplayer kills the X server and we end up at the login prompt.
    1. Fixed: didn't kill X, just went to the wrong vt. Now vtsrc should be "3" instead of "2" in videofe.cfg.
  3. videofe's parse() doesn't handle filenames with spaces. This can be fixed by parsing the command, dropping the last arg (%s) and then replacing it with the filename.
    1. Fixed: parse only configured command, but not with filename, then do filename substitution in args[] list for %s in configured command.
  4. The default kernel is huge: 9M, not including driver modules. I'm sure this could be slimmed down.

I need to fix these and the issues above and push to the rpi branch. Then I'll look into the omx keyboard issue.

Actions #10

Updated by Hammel almost 8 years ago

  • Severity changed from 03 - Medium to 01 - Critical
Actions #11

Updated by Hammel almost 8 years ago

Except for the kernel image size, everything else is done. I used the RPi 2 on a camping trip this past week and it worked quite well. The VideoFE was more responsive than on the RPi 1.

I've merged these changes into a build for RPi 1 and test booted. This failed initially because I accidently built the latest kernel (4.4.y) instead of the original (3.14.y). Using the new kernel (and likely the new firmware) requires copying all the firmware files just as with RPi 2. Eventually I'll need to remove files to find out which ones are not required.

Once I got this booted the rootfs ran except for starting X. The init script fails with "illegal instruction", however running xinit manually works. So I need to dig through the init script to find out what has the illegal instruction.

What this tells me is that most of the changes for RPi 2 will work with RPi 1, even using the same kernel. The main difference is the toolchain. In the process of porting I found bugs with the various applications and with the meta build to make sure I was building against the correct staging trees.

So this is nearly done. I have to cleanup the RPi 1 build and then merge with upstream master. I still need to test the opkgs on the RPi 1 and that may show problems, however.

Actions #12

Updated by Hammel almost 8 years ago

The illegal instruction comes from /opt/vc/bin/tvservice which is being used to determine if the HDMI is plugged in or not.
The illegal instruction is likely do to the settings used for -mcpu and -mfpu. I currently use

CPU=generic-armv7-a
MFPU=vfpv4

But according to the userland forum (also see the raspberry pi forum) I should use this (for gcc 4.8 or later)

MCPU=cortex-a7
MFPU=neon-vfpv4

So I need to rebuild everything, since the toolchain needs to be rebuilt. Might be a good time to upgrade the kernel used for the toolchain too, as it's 3.14 and the new RPI/RPI2 kernel is 4.4. I'm already using gcc 4.8.5 (mainline, not linaro) so that should be fine with these updates.

Actions #13

Updated by Hammel almost 8 years ago

Ugh. So while that's an issue for performance, my issue with withe RPI 1 build (not RPI2) so that won't fix it. The problem might be with the kernel used in the toolchain for rpi1. What I need to do is bump down to the 3.14.y kernel for rpi1 and make sure that is being used and not the 4.4.y kernel used for rpi2.

Actions #14

Updated by Hammel almost 8 years ago

The problem was that the wrong cpu, fpu and arch were set in pibox.cmake for the gles (re: userland) component. Fixing that boots the rpi b+ normally.

However, I noticed that the inittab change is not in the core system. And that makes sense because it's only needed if you use the pmsui package. So I need to add a preinst script to the pmsui package that saves the old inittab and installs a new one and a postrm script that restores the saved inittab.

I also found that the videofe.cfg settings are not board specific. So I need to fix the install to handle setting the vtsrc correctly for each board type.

Actions #15

Updated by Hammel over 7 years ago

Full build test for rpi1 and rpi2:
  1. With latest firmware and 4.4.y, mkinstall.sh needs to copy all firmware (except overylays directory) files to boot partition now. It can then remove the two kernel files before install the HW-specific kernel file.
  2. videofe now needs to be changed to have vtsrc set to 3 instead of 2. This is applicable to both HW builds.

After that I may be done with the port. Finally!

Actions #16

Updated by Hammel over 7 years ago

  • Status changed from In Progress to Closed
  • % Done changed from 80 to 100

Verified fixes on both platforms. All changes committed and pushed.

Closing issue.

Actions

Also available in: Atom PDF