[Discussion] How does the supply chain of the machine learning framework look like?

OpenAI API
August 1, 2020
Germany’s imminent decision on Huawei, does it matter? (Opinion)
August 1, 2020

[Discussion] How does the supply chain of the machine learning framework look like?

[Discussion] How does the supply chain of the machine learning framework look like?

I am currently doing research on the software supply chain. To be more specific, for example, for TensorFlow, its supply chain has multiple layers: the core of the supply chain is TensorFlow, while the other layers are the projects that directly import and indirectly import TensorFlow.

Indirect import means that if project 'A' imports TensorFlow and 'A' has published a package 'PA', project 'B' imports this package, the relationship between 'TensorFlow' and 'B' will be called as an indirect import, as shown in the figure.

Example of direct and indirect import

We wrote a script and analyzed all the projects in GitHub to built this supply chain. We found that the number of the layers in the supply chains is no more than five, no matter for TensorFlow, Pytorch, or Keras. The following figure is the supply chain of Pytorch.

The supply chain of PyTorch. Nodes represent projects and edges represent import relationships. The core node is PyTorch.

Unfortunately, the above is only a superficial understanding of the structure of the supply chain. In addition, I am more curious about its structure from the perspective of functionality, e.g., is there a difference in the application areas of projects at different levels (e.g., most of the projects in layer 1 are about image classification and text classification, whereas layer 2 are tools. I have to admit this example is inappropriate but it can reflect what I want to know)? Eventually, I want to build the landscape of the machine learning supply chain like the following example Hadoop.

https://preview.redd.it/bvvz5nn264e51.png?width=835&format=png&auto=webp&s=6ce758d9ba67f97f06a2724a1a78c7d742594ef4

Do you have a general idea of what kind of projects are on each layer?

submitted by /u/Sunflowerspku
[link] [comments]

Source

Comments are closed.