Build for Netgear R7800

hnyman · May 19, 2018, 2:30pm

No.
There is discussion on developer mailing list but there seems to be kernel size limitations that affect R7800.

You should also read the r7800 exploration thread in forum, as that thread is for this kind of generic device development discussions.

steom · May 19, 2018, 3:06pm

the packages are built but after update lists: Signature check failed.

for now using #option check_signature 1

hnyman · May 19, 2018, 4:59pm

You can manually download the packages.
Or I think that you can override the package list signature check with opkg options.

The reason for the signature failure is that I compiled my own build before jow had added the 18.06 keys to the keyring that is included in the build.

You could also manually copy the 18.06 key to your key directory.
https://git.openwrt.org/?p=keyring.git;a=shortlog

My next 18.06 build will naturally then contain the key.

PacketMan · May 19, 2018, 6:01pm

@steom - after the packages got built, I got the packages on my R7800 with git-18.135.22030-f3b3051 to work when I used #option check_signature 1

@hnyman - thanks for your 18.06 build. Do you know if the 18.1 release will use kernel 4.14 with hardware nat/flow offloading. A link in the 7800 exploration thread showed a patch where they seemed to overcome the kernel size limitation on R7800.

hnyman · May 19, 2018, 6:22pm

I know. In 18.06 the ipq806x target uses kernel 4.9.
No offloading.

18.06 has already been branched, so now new major features or major kernel version bumps will happen in 18.06.

Maybe then for 18.11 or whatever will be the next one.

slh · May 19, 2018, 8:42pm

The kernel partition of all Netgear ipq806x devices is sadly only 2 MB large, with kernel 4.14 we need a tad less than 2.3 MB. If you'd treat ipq806x like a -tiny target (using CONFIG_OPTIMIZE_INLINING=y, CONFIG_CC_OPTIMIZE_FOR_SIZE=y, CONFIG_KERNEL_DEBUG_INFO=n, CONFIG_KERNEL_DEBUG_KERNEL=n, CONFIG_KERNEL_KALLSYMS=n, ...), you can still fit into its original partition, but bang on the limit of 2'097'152 bytes, so you'd be living on a razor's edge.

Therefore my proposed patch collection for kernel 4.14 support resizes the kernel partition for all affected routers to at least 3 MB (4 MB in case of the r7800), as mentioned in that commit, installing an image with a different partition split (on NAND devices) requires flashing via tftp recovery (in both directions). Unfortunately the constraints of 2 MB don't leave many alternatives. See http://lists.infradead.org/pipermail/openwrt-devel/2018-May/012332.html and http://lists.infradead.org/pipermail/openwrt-devel/2018-May/012344.html for details.

Edit: Just to clarify, sysupgrade can't cope with different partition splits on NAND, reverting to OEM or 2-MB-kernel-partition firmware images is possible via push-button tftp recovery (which you have to use for migrating to 4-MB-kernel-partitions as well), so -while disruptive- it's not a one way street.

shelterx · May 20, 2018, 9:12am

Your guess then, will 4.14 kernel fit sometime in the future?
Btw, how come it's bigger when it's mostly based on modules and is hardware specific built? Did they really change that much generic stuff?

slh · May 20, 2018, 11:22am

That is not what I said, on the contrary.

hnyman · May 20, 2018, 6:41pm

owrt1806-r6917-8948a78862-20180520

18.06 buildbot signing keys have been added to the keyring today, so the new build is able to normally download 18.06 packages with opkg.

steom · May 20, 2018, 6:58pm

Fastpath is included? How to enable?

hnyman · May 20, 2018, 7:06pm

Fastpath is not enabled. I tested it a few months ago but did not benefit from it.

If you want it, build the image by yourself. (And use dissent's cleaned up patch, available from GitHub pull requests. Gwlim's original approach contains lot of garbage.)

fantom-x · May 20, 2018, 7:33pm

Getting this error below with that build. Not sure what file I need to remove.

opkg update
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/targets/ipq806x/generic/packages/Packages.gz
Updated list of available packages in /var/opkg-lists/openwrt_core
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/targets/ipq806x/generic/packages/Packages.sig
Signature check failed.
Remove wrong Signature file.

hnyman · May 20, 2018, 7:56pm

works for me.

 OpenWrt 18.06-SNAPSHOT, r6917-8948a78862
 -----------------------------------------------------
root@LEDE:~# opkg update
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/targets/ipq806x/generic/packages/Packages.gz
Updated list of available packages in /var/opkg-lists/openwrt_core
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/targets/ipq806x/generic/packages/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/packages/arm_cortex-a15_neon-vfpv4/base/Packages.gz
Updated list of available packages in /var/opkg-lists/openwrt_base
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/packages/arm_cortex-a15_neon-vfpv4/base/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/packages/arm_cortex-a15_neon-vfpv4/luci/Packages.gz
Updated list of available packages in /var/opkg-lists/openwrt_luci
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/packages/arm_cortex-a15_neon-vfpv4/luci/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/packages/arm_cortex-a15_neon-vfpv4/packages/Packages.gz
Updated list of available packages in /var/opkg-lists/openwrt_packages
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/packages/arm_cortex-a15_neon-vfpv4/packages/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/packages/arm_cortex-a15_neon-vfpv4/routing/Packages.gz
Updated list of available packages in /var/opkg-lists/openwrt_routing
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/packages/arm_cortex-a15_neon-vfpv4/routing/Packages.sig
Signature check passed.
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/packages/arm_cortex-a15_neon-vfpv4/telephony/Packages.gz
Updated list of available packages in /var/opkg-lists/openwrt_telephony
Downloading http://downloads.openwrt.org/releases/18.06-SNAPSHOT/packages/arm_cortex-a15_neon-vfpv4/telephony/Packages.sig
Signature check passed.

I have flashed quite normally with sysupgrade while keeping settings.
There shouldn't be any specific setting that would remove keys added by the build.

You can debug just by "cat" the keys in /etc/opkg/keys . One of the keys should be the 18.06 build key:

 OpenWrt 18.06-SNAPSHOT, r6917-8948a78862
 -----------------------------------------------------
root@LEDE:~# cat /etc/opkg/keys/*
untrusted comment: OpenWrt 18.06 public key
RWQQNaxzzE5Z41cVmEh2rilAPKLsyfPKm+S4BJWA1Yv+LP1hKebmGtXi
untrusted comment: Local build key
RWQX7BTw0VWIJB+Kk0d84XoiWWVHn6/5mPzabfrileOgOTpVlcXmcT/M
untrusted comment: LEDE usign key of Hans Dedecker
RWRRUfaUIMP1CAL9wvk3ABBHdUM+3SjMvIuJlK68b3b04Pw3wiaiAfxX
untrusted comment: LEDE usign key of Jo-Philipp Wich
RWRypX8hkbIR4FLhtx5pjXcAIsI1iPUIcI5bMG8jZoiCkrwTstECBPqL
untrusted comment: LEDE 17.01 "Reboot" public key
RWR5LZ2bOfGA3FGliZosEDhodiAKDOISmQs/mmjo4rhcbFtqkibJqMzo
...

fantom-x · May 20, 2018, 8:09pm

Thx, turned out I was using your earlier build from today.

R7800-owrt1806-r6914-54a864d914-20180520-2010-sqfs-sysupgrade

hnyman · May 20, 2018, 8:18pm

Yeah, with the earlier build I noticed that although devs had added the 18.06 key to the keyring, they had not updated the keyring Makefile. After I prompted them, devs updated that Makefile, and the r6917 build finally had the new keys.
https://git.openwrt.org/?p=openwrt/openwrt.git;a=shortlog;h=8948a78862abd975422d742152408249de6eadcf

nekromantik · May 20, 2018, 8:24pm

So are the master builds still ahead of the 18.06 builds?

fantom-x · May 20, 2018, 8:29pm

Do you mid sharing a link to this PR? I am not seeing it in the OpenWRT repo: there are only two unrelated PRs from dissent1 there.

hnyman · May 21, 2018, 4:24am

Reference can be found in the fast path thread...
Pull request is on the old LEDE GitHub site:

github.com/lede-project/source

[RFC] package: add Shortcut Forwarding Engine driver

lede-project:master ← dissent1:sfe

opened 10:15AM - 02 Aug 17 UTC

dissent1

+12187 -0

Add an opensource Qualcomm Shortcut FE driver. The driver consists of: - sfe… (core modules): shortcut-fe (ipv4) and shortcut-fe-ipv6 - modules that actually do the offloading - shortcut-fe-cm - simple shortcut-fe connection manager - a module that creates offloading rules and passes to sfe - fast-classifier - advanced connection manager - a module that creates offloading rules and passes to sfe. Comparing to sfe-cm has additional checks, connection statistics and creates an offloading rule only when a connection hits 128 packets flowed (can be adjusted through /sys/fast_classifier/offload_at_pkts) - userspace-fast-classifier - a fast-classifier user-space tool to manually add connections one want to offload Both sfe-cm and fast-classifier get information about connections through netfilter. And after some checks it creates an offloading rule that is passed to sfe. After that sfe marks a connection as fast-forwarded and routes the flow. Kernel parses this mark and bypasses its network stack taps for a specific connection in favor of sfe. There are 3 patches added with this commit: 950 - adds a hook into network stack, sets no tcp window check to 0 (according to sfe readme). 951 - because fast-classifier also supports bridge offloading (echo 1 > /sys/fast_classifier/skip_to_bridge_ingress) and offloaded connections do not naturally update bridge statistics, fast-classifier will do that. 952 - allow multiple listeners for conntrack events, it is requied for netlink and sfe coexistance (for example) All these patches are filled with ifdefs so the sfe code path is engaged only when these modules are compiled. It allows to keep kernel code untouched in case of no sfe compiled in. Because sfe-cm and fast-classifier are competing modules, It's recommended to keep loaded only one of them. If both are loaded then in a race condition sfe-cm always comes first. The driver is a merger of https://source.codeaurora.org/quic/qsdk/oss/lklm/shortcut-fe/log/?h=release/endive_cc with https://chromium.googlesource.com/chromiumos/third_party/kernel/+/chromeos-3.18/drivers/net/ethernet/qualcomm/sfe/ I've also added missing function to update udp statistics by fast-classifier and some more small fixes. Patches are taken from QSDK and that chromeos-3.18 repo and a bit adjusted.

hnyman · May 21, 2018, 4:28am

Sure. 18.06 was branched off the master a week ago, and will not see much actual development in future. Mostly bug fixes etc.

All new stuff gets into master. E.g. the Luci rollback is now already merged into master.

So master will go forward, while 18.06 will remain stable by having only minor changes.

StSaens · May 21, 2018, 7:11am

Just upgraded to R7800-master-r6931-4ff23afdcc-20180517-2124-sqfs-sysupgrade. Not getting wireless speed above 25mbit/s. Any idea on how to figure out the cause?
Wired speed is fine.