The need of an Accelerator Operating System

  • Easy deployment: Software developers can invoke the functions that want to accelerate in the same way that it is done on any other software framework. Software developers do no need to worry about the buffer management, the configuration file of the FPGAs, etc. InAccel’s unique orchestrator overloads the specific functions that need to be offloaded to the FPGAs. Users can use accelerators in the same way as it would have been done using software libraries. Software developers can deploy their applications using simple C/C++, Python and Java API calls and not OpenCL. They can also utilize accelerators from high level framework like Spark and Jupyter.
  • Seamless resource management: Multiple applications or users or processes can share the available resources without the user having to do manually the contention/conflict management. InAccel’s orchestrator serves as the scheduler that allows the sharing of the available FPGA resources in an FPGA cluster from multiple applications, multiple processes or multiple users-tenants.
  • Instant Scaling: Users just invoke as many times as they need the function that they want to accelerate without having to manually distributed the functions to the available resources. Whether there are many kernels on a single FPGA or multiple FPGAs on a single server, InAccel’s Coral Orchestrator performance the load-balancing and the distribution of the functions that need to be accelerated to the available resources. InAccel also provides the Kubernetes plugin in which the available resources are advertised to Kubernetes to allow application to scale-out to multiple Server (with multiple FPGAs per server.)
  • Heterogeneous deployment: InAccel unique bitstream repository allows the deployment of fully heterogeneous FPGA clusters. InAccel bitstream repository holds different bitstreams for the available FPGAs. The bitstream repository is integrated with the Coral Orchestrator alleviating the user from the complexity of FPGA-specific bitstreams. Users can deploy their application to heterogenous FPGA clusters (e.g. different FPGA cards from the same or different vendors) and InAccel FPGA orchestrator takes care for loading the right bitstream.

--

--

--

Applications Acceleration instantly

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

⚠️ SCAM ALERT ⚠️

Introduction to Software Architecture — Quality Attributes Requirements (Part 2)

software architecture — quality attributes

Building A Simple Login System with Authentication and Ruby on Rails

Great news for product teams and digital agencies!

**********DevOps Task 6*********

How to set up Ghost blog on Ubuntu Server in Azure

Ubuntu 18.04 + Lenovo X1 Carbon (6G)

Systems study

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
InAccel

InAccel

Applications Acceleration instantly

More from Medium

Almighty Opensource project about machine learning you should try out

Release of Kubeflow 1.5 — what it means for your business?

SuperAnnotate vs Diffgram

Training a Computer Vision Model on VertexAI (with and without Explanable option)