Monthly Archives

July 2019

Fujitsu and GE Research Join LF Edge as Premier Members to Propel Open Source Innovation at the Edge

By | Announcement

Global cutting-edge organizations join LF Edge to participate innovating at the edge, impacting future of networking and IoT

TOKYO — Open Source Summit Japan —  July 18, 2019 LF Edge, an umbrella organization within the Linux Foundation that aims to establish an open, interoperable framework for edge computing independent of hardware, silicon, cloud, or operating system, today announced Fujitsu, a leading Japanese information and communication technology (ICT) company, and GE Research, GE’s innovation powerhouse where research meets reality, have joined LF Edge as Premier members.

“We are pleased to welcome Fujitsu and GE Research as the newest Premier members of LF Edge,” said Arpit Joshipura, general manager, Networking, Automation, Edge & IoT, the Linux Foundation. “Their expertise across technology sectors and experience in delivering leading products, solutions, and research at the forefront of the industry will be instrumental in helping the LF Edge community establish a common platform for edge computing.”

Launched in January of this year,  LF Edge is initially comprised of five projects – including Akraino Edge Stack, EdgeX Foundry, Home Edge, Open Glossary of Edge Computing, and Project EVE –  that will support emerging edge applications across areas such as non-traditional video and connected things that require lower latency, and  faster processing and mobility. By forming a software stack that brings the best of cloud, enterprise and telecom, LF Edge is helping to unify a fragmented edge market around a common, open vision for the future of the industry.

“Edge computing is critical to unlock innovative ICT applications and use cases promised by 5G.  Fujitsu views LF Edge as the most comprehensive and active open community addressing edge framework,” said Hatsumi Iino, senior director, Strategic Planning unit, Fujitsu Limited. “Fujitsu is committed to using and contributing to open technologies, and looking forward to working with the LF edge community on customer and societal challenges.”

“GE Research has been a strong adopter of Linux technologies and leader in driving Edge Computing capabilities,” said Joel Markham, chief engineer, GE Research. “We are excited to join LF Edge and continue that work while collaborating on resources and sharing assets across organizations and industries.”

Fujitsu is the leading Japanese information and communication technology (ICT) company, offering a full range of technology products, solutions, and services. The company uses its experience and the power of ICT to shape the future of society.  

GE Research is GE’s innovation powerhouse where research meets reality.  It’s a world-class team of 1,000+ scientific, engineering and marketing minds (600+ Ph. Ds), working at the intersection of physics and markets, physical and digital technologies, and across a broad set of industries to deliver world-changing innovations and capabilities. To learn more, visit https://www.ge.com/research.

Fujitsu and GE Research join a growing roster of 70+ current members, which includes existing Premier members Aricent, Arm, AT&T, Baidu, Dell EMC, Dianomic Inc., Ericsson, HP Inc., HPE, Huawei, IBM, Intel, inwinStack, Juniper Networks, MobiledgeX, Netsia, Nokia Solutions, NTT, OSIsoft, Qualcomm Technologies, Radisys, Red Hat, Samsung Electronics, Seagate Technology, Tencent, WindRiver, Wipro, and  ZEDEDA. A full list of LF Edge members can be found here: https://www.lfedge.org/members/

More details on LF Edge, including how to join as a member, and details on specific projects, are available here: www.lfedge.org.

Upcoming Events

LF Edge will host a workshop discussing how LF Edge and its projects are working together to create a common framework for edge computing, onsite at Open Source Summit North America, August 21-23 in San Diego, Calif. More details on the “State of the (LF) Edge” workshop are available here. 

The LF Edge community will also be onsite at Open Networking Summit (ONS) Europe, September 23-25 in Antwerp, Belgium. The event features an entire track dedicated to Edge & IoT and will also include edge-related keynote presentations. Register before July 28 to save $800. 

About The Linux Foundation

Founded in 2000, the Linux Foundation is supported by more than 1,000 members and is the world’s leading home for collaboration on open source software, open standards, open data, and open hardware. Linux Foundation’s projects are critical to the world’s infrastructure including Linux, Kubernetes, Node.js, and more.  The Linux Foundation’s methodology focuses on leveraging best practices and addressing the needs of contributors, users and solution providers to create sustainable models for open collaboration. For more information, please visit us at linuxfoundation.org.

# # #

The Linux Foundation has registered trademarks and uses trademarks. For a list of trademarks of The Linux Foundation, please see our trademark usage page: https://www.linuxfoundation.org/trademark-usage. Linux is a registered trademark of Linus Torvalds.

End User Case Study: Monitoring a Water Treatment Skid Using EdgeX Foundry

By | Blog, EdgeX Foundry

By Jason Shepherd, LF Edge Board Member and Dell Technologies IoT and Edge Computing CTO

Founded in 1996, Technotects is an IoT technology consulting firm with broad domain expertise in industrial use cases. When one of their customers in the water treatment industry independently realized the power of the EdgeX Foundry framework, Technotects planned and executed a Proof-of-Concept (PoC) with one of their customer’s typical use cases via a “bake off” with the proprietary solution from their current edge platform ISV.

This blog walks through the successful PoC, including what the solution entailed and Technotects’ experience working with the EdgeX platform. We’re seeing more and more of these types of real-world applications go public in the community on the heels of the EdgeX Foundry “1.0” Edinburgh release.

The use case

The use case for the PoC is monitoring sensor and pump information from industrial chemical dosing skids for water treatment as illustrated in the figure below. Technotects’ goal of the effort was to prove that the EdgeX Foundry platform, combined with commercial value-add from the ecosystem, can provide equal to, or better, capabilities to their customer’s current edge solution, all while giving them the freedom of choice by being decoupled from a proprietary, single-vendor solution. In turn, this would allow their customer to improve their overall solution architecture, time-to-market and reduce runtime royalties.

“EdgeX Foundry addresses the problem of the license stack at the IoT Edge constantly increasing in cost by providing a well-architected, high performance, open source platform that can be used for industrial solutions today.”Mike Malone, Vice President, Technotects, Inc.

The end customer’s initial interest in EdgeX Foundry was the flexibility offered by the open ecosystem and the potential of reducing excessive runtime licensing fees per deployed host node, based on the combination of their supplier’s proprietary edge application framework, edge historian and both southbound and northbound connectivity. In addition, they were attracted to the ability to make build-or-buy decisions with EdgeX without being locked into any specific choice for connectivity or applications value-add services.

The PoC basics

For the PoC, Technotects leveraged a Dell Edge Gateway 3002, Photon OS and VMware Pulse IoT Center, Edge Xpert from IOTech, RedisEdge from Redis Labs, Ignition from Inductive Automation, Project Iris from RSA Labs, Azure from Microsoft (hosting Redis for data backup) and the end customer’s own backend console. Refer to the figure below for a block diagram of the setup and read on for more detail on how the effort came together.

Solution deep dive

For the EdgeX foundation of the stack, Technotects chose to work with IOTech’s Edge Xpert offering – a commercially-supported variant of the open source code that is available from the project GitHub within the Linux Foundation. Their use of Edge Xpert enabled them to focus on the integration with their customer’s preferred value-add rather than dealing with the open source code. They found IOTech’s documentation to be clear and the initial installation to be quick and straightforward – benefits when using a commercial variant that has additional hardening and packaging. Of course, using a commercially-supported variant versus simply downloading the open source code is a matter of personal preference.

EdgeX is completely neutral to OS, underlying hardware, protocol and programming language, and for this PoC, Technotects chose to leverage the Dell Edge Gateway 3002 and both Ubuntu from Canonical and Photon OS. Photon OS is an open source, container-optimized Linux distribution that has been nested within VMware’s vSphere offering for some time. Technotects was able to run their console, Ignition, Edge Xpert and all the other referenced value-add in Docker containers in both operating systems, all without issue. They find that having the flexibility to deploy on any combination of hardware (x86 or ARM) and operating systems (Linux or Windows) in the field depending on customer need is valuable.

For southbound connectivity, Technotects leveraged a hybrid model. Their customer’s water treatment skids leverage an Allen Bradley CompactLogix PLC for dosing control and for this PoC, Technotects used Inductive Automation’s robust Ignition Ethernet/IP driver to communicate with it. In turn, they connected this off-the-shelf, licensed driver package into the OPC-UA Device Service native to EdgeX. To connect to other devices on the skid, Technotects used the Modbus TCP protocol from IOTech’s Edge Xpert offering, written using the native EdgeX Device Service SDK. With the plug-in Device Service model, any combination of devices and protocols can be readily added in the future as their customers’ needs evolve.

The solution architecture is a great example of both 1) how existing connectivity stacks can be used alongside native EdgeX Device Services in a hybrid model and 2) that in the EdgeX model, even connectivity written with the open EdgeX Device Service SDK can be monetized. Commercially-supported variants of EdgeX Device Services are likely to be attractive to end users with mission-critical use cases that involve bespoke and/or proprietary protocols in that support for this southbound connectivity often requires institutional knowledge gleaned from reverse engineering.

Meanwhile, end users can benefit from a growing number of open source Device Service options available within the community and increasingly Device Services that are supported by sensor makers for greenfield applications, coming with the sensor just like a keyboard comes with a driver for a PC. (Side note: There are numerous additional opportunities in development in the EdgeX ecosystem, although I must be sensitive to NDAs until they’re made publicly available). Net-net, the value of the open, vendor-neutral EdgeX ecosystem is in providing developers and end users with choices based on whatever is most valuable for their business.

Technotects leveraged VMware’s Pulse IoT Center to manage and monitor the underlying gateway hardware, OS and the EdgeX application framework above. VMware Pulse is a massively scalable, platform and application-independent solution for onboarding, managing, securing and monitoring IoT devices and gateways. System update campaigns can be applied in bulk and admins are alerted to any issues with their devices deployed out in the field, all in real-time. While VMware Pulse can be used standalone with its embedded device agent, it’s especially powerful when used in concert with the EdgeX framework. Any preferred console to manage applications and the underlying host system can be used with the EdgeX framework, with application-level functionality being enhanced by taking advantage of the EdgeX System Management Agent (SMA).

Technotects found the northbound connectivity to both Azure and AWS available in IOTech’s Edge Xpert to be very easy to configure. This highlights a key benefit of the EdgeX framework – decoupling investments in southbound data ingestion from any given cloud to enable choice over the long term, including realizing true-multitenancy from the edge. With the addition of support for multiple application services in the recent 1.0 Edinburgh release, data related to infrastructure monitoring and management can be sent to their management console of choice (in this case VMware’s Pulse IoT Center), whereas data related to the process for data analytics and taking action can be sent to any combination of on-prem or cloud-based application stacks of choice.

For local data persistence, Technotects chose RedisEdge over the MongoDB reference database that has been the baseline in the project until the recent 1.0 Edinburgh release. Technotects found it very easy to replace MongoDB with RedisEdge with no functionality differences, thanks to the work of Redis Labs in terms of making it an available plug-in within the EdgeX ecosystem. This is yet another example of how EdgeX is truly open and vendor-neutral, enabling users to leverage any enhancing functionality of their choice.

Finally, the PoC explored RSA Labs’ Project Iris active threat monitoring solution. Iris is a container that plugs into the EdgeX framework (and any other stack that supports containers) to profile baseline behavior for the stack and connected devices and then uses machine learning to detect anomalies. In turn Iris create alerts linked back to RSA’s popular Netwitness offering.

“Our customers like EdgeX Foundry because it provides a well architected, open source path to eliminate proprietary and expensive alternatives in their IoT Edge software stack.”Mike Malone, Vice President, Technotects, Inc.

 

Conclusion

In closing, Technotects found EdgeX Foundry easy to work with and was able to successfully replicate their customer’s use case for water treatment skid monitoring by leveraging the commercially-supported framework from IOTech and value-add from Canonical, Dell, Inductive Automation, Redis, RSA and VMware. The flexibility to simply plug value-add into the open, vendor-neutral EdgeX foundation will provide both Technotects and their customers with more options in the future and help mitigate lock-in to expensive runtime licensing fees and support contracts.

The EdgeX project has matured over the past two years to the current 1.0 state, and if you’re one of the thousands of end users that has been quietly prototyping with the platform, we welcome you to come forward and share your story on the project website through a blog or simple testimonial statement. The more people that come forward to share their success stories, the faster EdgeX will become the de-facto standard interoperability framework for the IoT Edge and the more we can all focus on innovation rather than reinvention!

Thank you for your time, and now’s your time to download the code or contact any of the providers in the ecosystem and build something great! Perhaps, as many have, even start your own business model around the EdgeX framework – just think of what Android did for scaling out an application and services ecosystem for mobile devices.

Stay tuned for more stories like this from end users that appreciate the power of EdgeX Foundry!

EdgeX Foundry Announces Production Ready Release Providing Open Platform for IoT Edge Computing to a Growing Global Ecosystem

By | Announcement, EdgeX Foundry

  • Enables IoT digital transformation for Enterprise, Industrial, Retail and Consumer
  • Supports complementary products and services from global open ecosystem including commercial support, training and customer pilot programs
  • Deployed in many end user projects; EdgeX also collaborates with IIC on AI testbeds and is the foundation for the Open Retail Initiative (ORI)

SAN FRANCISCO  July 11, 2019EdgeX Foundry, a project under the LF Edge umbrella organization within the Linux Foundation that aims to establish an open, interoperable framework for edge IoT computing independent of hardware, silicon, application cloud, or operating system, today announced the availability of its “Edinburgh” release. Created collaboratively by a global ecosystem, EdgeX Foundry’s new release is a key enabler of digital transformation for IoT use cases and is a platform for real-world applications both for developers and end users across many vertical markets. EdgeX community members have created a range of complementary products and services, including commercial support, training and customer pilot programs and plug-in enhancements for device connectivity, applications, data and system management and security.

Launched in April 2017, and now part of the LF Edge umbrella, EdgeX Foundry is an open source, loosely-coupled microservices framework that provides the choice to plug and play from a growing ecosystem of available third party offerings or to augment proprietary innovations. With a focus on the IoT Edge, EdgeX simplifies the process to design, develop and deploy solutions across industrial, enterprise, and consumer applications.

The fourth release in the EdgeX roadmap, Edinburgh offers a stable API baseline for the standardization of IoT edge applications that future-proof IoT investments by fostering an ecosystem of interoperable microservice-based capabilities and decoupling investments in edge functionality in areas such as connectivity, security and management from any given backend application or cloud. The EdgeX framework is designed to facilitate the secure deployment and management of devices and applications at the edge to accelerate time-to-market and enable new data-based services and capabilities such as Artificial Intelligence (AI) and Machine Learning (ML).

“Since its launch, EdgeX Foundry has experienced significant momentum in developing an open platform that can serve as the industry framework for IoT and edge-related applications,” said Arpit Joshipura, general manager, Networking, Edge and IoT, the Linux Foundation. “EdgeX Foundry is one of the anchor projects for LF Edge and Edinburgh release is a major step in unifying open source frameworks across IoT, Enterprise, Cloud and Telco Edge.”

“Having started the EdgeX movement with a small team at Dell before contributing the code to the Linux Foundation, it’s certainly amazing to see the traction we’ve gotten through open, vendor neutral collaboration in a few short years,” said Jason Shepherd, former chair of the EdgeX Foundry Governing Board and IoT and Edge CTO, Dell Technologies. “It’s a testament to the power of the network effect in the open source community which ultimately enables developers to focus on value rather than reinvention.”

Edinburgh is Ready for Production Deployment

EdgeX Foundry’s community adoption continues to accelerate. Currently, there are more than 100 unique contributors to the project and code downloads are approaching 5,000 a month at a 75% month-to-month growth rate. Momentum is expected to continue with EdgeX’s Edinburgh release and rapidly growing commercial support in the ecosystem.

Key features for this release include:

  • Stability: Stable API’s protecting future investment and supporting future long term support
  • Connectivity: More SDKs for north and southbound connectivity and a wider range of standard connectors
  • New Features: Significant new features, including binary data support, database swapability and improved APIs to help facilitate management/monitoring capability
  • Global Support: Support from the global EdgeX Foundry ecosystem – as well as the broader LF Edge umbrella community – that offers a range of complementary products and services

“With this EdgeX Edinburgh release, we will radically change how businesses develop and deploy IoT edge solutions,” said Keith Steele, chair of the EdgeX Foundry Technical Steering Committee and CEO of IOTech. “Edinburgh is a significant milestone that showcases the commercial viability of EdgeX Foundry and the impact that it will have on the global IoT edge landscape.”

Learn more about documentation, a new use case and the technical details for the Edinburgh release on the EdgeX website.

Market Utilization of EdgeX Foundry

Since the project inception, there have been tens of thousands of trials and pilot deployments of the EdgeX framework in the field and many of these are converting to production with the Edinburgh release. Several organizations already provide commercial solutions based on EdgeX, with many others folding it into their product roadmaps. For example:

  • Edge Xpert: From IOTech Systems, Edge Xpert uses the latest stable release of EdgeX Foundry to create a commercially supported solution from the baseline open source technology. IOTech will also soon announce hard real-time extensions to EdgeX.
  • MFX-1 IoT Edge Gateway: From Mainflux, the MFX-1 IoT Edge Gateway based on the EdgeX Foundry framework, is an edge computing solution supported with the EdgeFlux application for gateway management. Integrated with Mainflux IoT Cloud Platform it provides comprehensive Cloud /Edge IoT System.
  • NetFoundry Ziti Edge: NetFoundry’s Ziti Edge provides programmable, software-only “Northbound” connectivity for EdgeX Gateway applications and services. Based on Zero Trust security principles, with integrations for HW root of trust based identity and Trusted Execution Environments (TEE), Ziti Edge delivers secure “Silicon-to-Cloud” connectivity, using any Internet connection, while keeping both sides of the connection “dark” to the Internet.
  • VMware Supports EdgeX: Developers who deploy any combination of EdgeX Foundry and/or Project Photon OS with VMware Pulse IoT Center can receive support from VMware for both Pulse IoT Center and EdgeX open source software. When used with Pulse IoT Center’s device management capabilities, open source tools such as EdgeX offer developers increased control over how, when, and where they run their applications and manage their data.

The EdgeX framework is also being leveraged in various industry collaborations. For example, in collaboration with the Industrial Internet Consortium® (IIC) EdgeX is used as the foundation for the Optimizing Manufacturing Processes by Artificial Intelligence (OMPAI) testbed which explores the application of AI and industrial internet technologies, deployed from the edge to the cloud, to optimize automotive manufacturing processes.  EdgeX is also the foundation for the Open Retail Initiative (ORI) which has the goal of facilitating open innovation within the retail/commerce space.  Work for the ORI is manifested within the Commerce Working Group in the EdgeX project and initial target use cases include computer vision-assisted advanced loss prevention.

Planning Ahead

Later this summer, the first EdgeX Foundry ecosystem hackathon will be hosted in the Bay Area. This initial event will be tied to the Commerce Working Group, hosted by Intel within the EdgeX project, with various award categories for implementation of the EdgeX framework in retail use cases. The best all-around winner will get to showcase their solution at future LF Edge or EdgeX Foundry events. Details will be available in late July via the EdgeX website, email list and Slack channel.

Additionally, LF Edge will host a workshop entitled “State of the (LF) Edge” on August 20 in San Diego, Calif., co-located with  Open Source Summit North America (August 21-23).  More details are available here.

For more information about LF Edge and its projects, visit https://www.lfedge.org/

Support from Contributing Members and Users of EdgeX Foundry

  • “EdgeX Foundry is the key component of Beechwoods IoT gateway solution that allows our customers to engage confidently in edge computing technology. With the Edinburgh release, this solution will be ready to transition from customer engagement to product deployment.” – Brad Kemp, President, Beechwoods Software

 

  • “The Edinburgh release of EdgeX Foundry brings much needed standardization and stability for edge computing in production environments through an open source, common framework. The availability of the EdgeX Foundry snap enables developers an easy path to getting started with EdgeX Foundry, and benefit from confinement, easy integration into their own infrastructure, and automatic updates. In addition, this release introduces new device snaps providing integration with MQTT and ModBus.”- Loic Minier, IoT Field Engineering Director, Canonical

 

  • “As EdgeX Foundry reaches maturity with the Edinburgh release, CloudPlugs is excited to also announce the integration of the CloudPlugs IIoT platform with the open EdgeX ecosystem. CloudPlugs IoT is a robust backend to deploy, orchestrate and manage EdgeX-compliant devices and micro service-based applications, as well as to manage and visualize field data. The EdgeX framework provides new levels of flexibility in field-level interoperability and the combination of EdgeX with CloudPlugs IoT delivers a powerful, end-to-end software and service stack to digitize assets and to deploy commercial and industrial IoT solutions at scale.” – Jimmy Garcia-Meza, CEO, CloudPLugs Inc.

 

  • “EdgeX Foundry provides an important software platform standardizing on the south bound IoT device connectivity and northbound data storage connectivity and allows vendors to plug-in their core IoT capabilities in between. FogHorn is aligned with this data ingestion and publication standardization and will continue to collaborate as appropriate.” – Sastry Malladi, CTO, FogHorn

 

  • “The EdgeX platform offers HMS Networks a path to quickly build Industrial IoT solutions by providing predefined set of services for I/O functionality. HMS has created a J1939 service for EdgeX platform to help simplify IoT solutions for the commercial vehicle telemetry market. Ultimately, the EdgeX platform will significantly reduce the R&D investment required to create a majority of the Industrial IoT applications required in the market today.” – Tom McKinney, Director Engineering Services and Business Development, HMS Networks

 

  • “EdgeX Foundry is an important project arriving at the right time. It promises to connect devices to capabilities, and then get out of the way so you can run containerized workloads to generate insights, run model scoring, or detect anomalies… all at the edge. IBM is collaborating with EdgeX Foundry as part of our hybrid cloud strategy to help enterprises unlock the value of data from on-premises to the cloud to the edge.” – David Boloker, Distinguished Engineer, IBM

 

  • “EdgeX Foundry’s open source platform enables the industrial software ecosystem to integrate rapidly with ioTium’s managed services converged infrastructure offering – it’s microservices framework with open APIs is a powerful driver in the fragmented Industrial Control Systems market. ioTium enables rapid scalable deployment of the EdgeX Foundry framework globally.”- Ron Victor, CEO, ioTium

 

  • “EdgeX Foundry provides an open framework for ease of design, development, & deployment at the Edge, while addressing stringent security, privacy & compliance requirements. NetFoundry added its vendor-agnostic, connectivity-as-code solution to  EdgeX in order to enable developers and integrators to get similar ease of use, security and performance for their northbound application connectivity to core, clouds and service meshes. With the release of the EdgeX Edinburgh release, the EdgeX Foundry developer community has all the tools needed to deliver on market needs and ensure secure, agile innovation at the Edge” – Galeal Zino, CEO, NetFoundry Inc.

 

  • “As Digital Transformation for IoT gathers momentum, companies are demanding the same reliability, performance and security at the edge as they are used to getting from their Cloud Computing stack. With this release, EdgeX with Redis Labs RedisEdge not only delivers upon those expectations, but provides an ecosystem of open source technologies and plug-ins such as Redis Modules that help developers innovate.” – Dave Nielsen, Head of Community and Ecosystem Programs, Redis Labs

 

  • “EdgeX Foundry addresses the problem of the license stack at the IoT Edge constantly increasing in cost by providing a well architected, high performance, open source platform that can be used for industrial solutions today.” Mike Malone, Vice President, Technotects, Inc.

 

  • “EdgeX Foundry’s global community ecosystem has experienced explosive growth, and the tangible advances delivered in the EdgeX Edinburgh release are exciting developments for edge computing. We fully support EdgeX Foundry’s goals to establish an open interoperable framework for edge computing to provide developers with increased control over how, when, where and with whom they run their applications and manage their data. We look forward to continuing our contributions to the EdgeX Foundry community and related efforts in fostering open industry-wide innovation such as the Open Retail initiative.” – Mimi Spier, Vice President, Edge and IoT Business, VMware

 

  • “As a founding member of LF Edge, Wipro is proud to have contributed to the Edinburgh release. We will continue to actively participate as it is a key platform for delivering open, microservices-based, edge IoT applications for today’s interoperable distributed enterprise world.” – Andrew Aitken, general manager and global open source practice leader, Wipro Limited.

 

  • “ZEDEDA’s vision is to free cloud-native and legacy apps to run on any edge device anywhere in the world. This vision drives our support for EdgeX Foundry and its mission of promoting open interoperability between edge devices. We’ve made our virtualization solutions compatible with EdgeX releases because we believe they will have a central role in our industry’s future.” – Joel Vincent, VP Marketing, ZEDEDA

About the Linux Foundation

Founded in 2000, the Linux Foundation is supported by more than 1,000 members and is the world’s leading home for collaboration on open source software, open standards, open data, and open hardware. Linux Foundation’s projects are critical to the world’s infrastructure including Linux, Kubernetes, Node.js, and more.  The Linux Foundation’s methodology focuses on leveraging best practices and addressing the needs of contributors, users and solution providers to create sustainable models for open collaboration. For more information, please visit us at linuxfoundation.org.

###

The Linux Foundation has registered trademarks and uses trademarks. For a list of trademarks of The Linux Foundation, please see our trademark usage page: https://www.linuxfoundation.org/trademark-usage. Linux is a registered trademark of Linus Torvalds.

 

Using DockerHub in Akraino Edge Stack & Other Linux Foundation Projects

By | Akraino, Blog

By Kaly Xin, Eric Ball,  and Cristina Pauna

DockerHub is the world’s largest library and community for container images. It offers a huge repository for storing container images and it is available world wide. It can automatically build container images from GitHub and Bitbucket and push them to Docker Hub. These are just a few of the features it provides, but maybe one of the best features is that it offers seamless support for multi arch images through fat manifest.

Why Docker Hub is recommended for Multi-Arch

Docker Hub registry is able to store manifest list (or fat manifests). A manifest list acts as a pointer to other images built for a specific architecture thus making it possible to use the same name for images that are built on hardware with different architectures.

Figure 1: Docker registry storing amd64, arm64 images and their fat manifest

In the picture above akraino/validation:k8s-latest is the fat manifest, and its name can be used to reference both images akraino/validation:k8s-amd64-latest and akraino/validation:k8s-arm64-latest. Inspecting the manifest offers the details on what images it has, for what hardware architecture and what OS.

Figure 2: Docker fat manifest details

How does it work?

When building an image for a specific arch, the arch is added in the tag of the image (akraino/validation:k8s-amd64-latest and akraino/validation:k8s-arm64-latest).

After the images are pushed in the Docker Hub repo, the manifest can be created from the two images. Its name will be the same as the two images but with the arch removed from the tag (akraino/validation:k8s-latest).

To do this in CI with Jenkins, the Jenkins slave has to have docker and a couple of other LF tools installed. The connection to Docker Hub is done through LF scripts (see releng-global-jjb for more info) and all you need to do is define the jjb jobs .

The Akraino validation project is already pushing to Dockerhub, so if you would like to check out some template code, take a look at ci-management/jjb/validation. The docker images are pushed in the official repo and the docker build jobs are running daily. 

In the figure below, the main Jenkins job (validation-master-docker) triggers two parallel jobs that build and push into the Docker Hub registry the amd64 (akraino/validation:k8s-amd64-latest ) and arm64 (akraino/validation:k8s-arm64-latest ) images.  At the end, the fat manifest (akraino/validation:k8s-latest ) is done in a separate job. 

When pulling the image, the name of the manifest is used  (akraino/validation:k8s-latest); the correct image will be pulled based on the architecture of the host from which the pull is made.

Figure 4: Pulling a docker image from two different hardware architecture servers using the same name

What’s next

Docker Hub has been integrated in LF projects like OPNFV from the beginning and is now integrated in Akraino too, so other open source projects can refer to this successful experience to integrate Docker Hub in their pipeline.