Donate to e Foundation | Murena handsets with /e/OS | Own a part of Murena! Learn more

Commit f14e592e authored by Gaël Duval's avatar Gaël Duval 🏄🏼
Browse files

Update LLM comparison.md: add a synthesis to conclude

parent 3afcebf7
Loading
Loading
Loading
Loading
Loading
+21 −0
Original line number Original line Diff line number Diff line
@@ -6277,3 +6277,24 @@ General benchmarks (ours): (no benchmarks-general data available)
</details>
</details>




## Conclusion

The Phi-2 2.8B Transformer model represents a compelling choice for implementing open-source Large Language Models (LLMs) on smartphones, particularly within the /e/OS ecosystem. This model has demonstrated its potential by operating directly on mobile devices, such as the Murena Fairphone 5, showcasing the possibility of running sophisticated AI models locally without relying on cloud computing​ (/e/OS community)​.

### Potential uses on smartphones

* Privacy-Conscious Digital Assistants: The primary use case for Phi-2 2.8B on smartphones revolves around powering digital assistants that operate entirely offline. This capability is crucial for users concerned about privacy, as it ensures that data, such as calendar entries or personal requests, does not leave the device.

* Localized Processing for Accessibility Features: This model can potentially handle real-time language translation or accessibility features such as live audio transcription, which would be beneficial for users with hearing impairments.

* Smart Application Integration: By integrating this LLM directly with smartphone operating systems, applications can perform more complex tasks locally, such as summarizing emails, optimizing schedules, or even suggesting content based on user preferences without external data processing.

## Interest of using Open Source LLMs regarding Privacy

Open-source LLMs like Phi-2 2.8B offer significant benefits in terms of privacy and security:

* Transparency: Users and developers can inspect, modify, and fully understand the workings of the model. This transparency is crucial for trust and security, as it allows for the identification and correction of biases or vulnerabilities.
* Customizability: Being open-source, these models can be tailored to specific needs without the constraints typically imposed by proprietary solutions. This flexibility enables a more personalized and secure user experience.
* Community Support and Innovation: Open-source projects benefit from the support and innovation of a global community. This collective effort can accelerate improvements and adaptations of the LLM to new challenges and technologies.

The ongoing development and optimization of models like Phi-2 2.8B for mobile platforms are pivotal. As hardware capabilities on mobile devices continue to evolve, the feasibility of running complex models like the Phi-2 2.8B will increase, making these privacy-focused applications more practical and widespread.