Skip to content

Thanks for contributing to Machine Learning and AI with this repository! #233

Closed

Description

@Darlanio

I just want to say Thank You!

I got your solution working and I am happy to confirm that it is working as intended. The quality of text produced is probably a bit lower compared to text produced with the full weights, but the quantized weights saves a lot of space and maybe some processing time.

I would like to see the solution rewritten as C# to better understand it, since I am using C# at work but do not use C++ och C since I was studying programming in the 90s. I do understand this is not the main goal of this project, but in case someone else wants to do this or have already done this - please leave me a note.

Thanks again for this lovely work!

Activity

  1. bernatvadell commented on Mar 17, 2023

    @bernatvadell
    Contributor

    Hi @Darlanio

    Maybe I can follow up on PR #77. In this PR we are working to export the functionalities in a library (llama.cpp) that in principle could be imported without much effort in dotnet (C#) with DLLImport.

    A hug!

  2. locked and limited conversation to collaborators on Mar 17, 2023
  3. converted this issue into a discussion #236 on Mar 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions