Battle for the AI toolflow: Page 2 of 2

February 19, 2021 //By Nick Flaherty
Battle for the AI toolflow
There is a key challenge in creating an AI toolflow for developing artificial intelligence systems - whether to use an end-to-end system or combine a range of tools

“This is because it is all strongly tied to how (process) and what (product) is developed. The tools themselves may be from a third party as long as the appropriate interfaces have been clarified. It sets new requirements towards the tools themselves. Tools need to be open enough to integrate into the toolchain and work with each other seamlessly. It is quite rare for a large OEM to outsource the development toolchain and entirely rely on a single supplier.”

“Anyone who offers the whole flow, just go and do that. But if you ever need to leave it, you have a problem. If you need to join things together you want a tool to do that,” said Martin at MathWorks. “You can use Java, Python, C++, .NET, you can write code in different languages. I use Matlab to link things together.

A large organisation will not have one tool that does the while flow, he says. “Tensorflow lacks the pre processing – it's great for the training, and you can go through ONNX to Tensorflow and use our code generation tools. You might train in Tensorflow, quantise in our code to reduce the size of the model. That’s fine,” he said.

Automating a toolflow with different tools requires coding, he says. “When one tool doesn’t quite do the right thing for the next tool you are going to end up writing code. My conjecture is you will always end up massaging one into the next and you need a language for that. Every time you build a tool flow you are incurring a lot of risk when there’s a change, an upgrade – the more point tools you have the more risky your flow is. To de-risk the flow you want to minimise the point tools, minimise the dependencies,” he said.

“Companies that think carefully about their flows probably has as few tools in the flow as possible. If two tools are made by the same company you will probably chose those in a drive to a more unified flow, but you may need a language like Matlab or Python to put it together. We have lots of point tools down the workflow, we give you the language to make that possible."

“However, they will not have the expertise to create all components of this complex toolchain,” said Jánky at AImotive. “Environment, vehicle dynamics simulation, sensor models and cloud service will still be delivered by many different suppliers. Outsourcing the entire toolchain is a viable option for the new entrants who don’t have enough bandwidth to drive the toolchain development in-house along with the complete product development,” he said.

This is even more of an issue at the edge of the network.

“We saw our early hardware customers facing barriers to operation at the edge due to lack of software tools,” said Dinakar Munagala, CEO of Blaize, which has developed a chip and software development kit (SDK) for coders but also an end-to-end toolflow to simplify the process.  

“Today in edge computing there’s a huge dearth of tools to build AI applications,” said Munagala.

“While AI is migrating to the edge and outpacing the data centre the deployment is lagging as it takes too long to build the apps and deploy the apps to hardware. End to end software development is lacking,” he said. “The largely manual methods will give way to tools to fully automate AI workflows.”

Instead of using the Picasso SDK, AI Studio aims to provide such a end-to-end tool flow, tied to its hardware. This uses Python libraries and adding a public data market places and repositories to discover models and even complete applications.

The AI Studio toolflow is tightly integrated with the Blaize hardware but its based on open standards so the company says it can deploy to any hardware that supports open standards such as ONNX.

And despite offering a complete flow for edge AI, the company acknowledges that there are demands for a mixed tool chain.

“This is important as we recognise there are existing tools and workflows,” said Dmitry Zakharchenko Vice President Research & Development. “Providing the proper integration points would be the way to connect to the existing tools, so we have developed a robust set of APIs to integrate with existing tools especially in the data wrangling tools and we should be taking advantage of those tools.”;;

Related articles 

Other articles on eeNews Europe 

Vous êtes certain ?

Si vous désactivez les cookies, vous ne pouvez plus naviguer sur le site.

Vous allez être rediriger vers Google.