BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Huntsville AI - ECPv6.8.3//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Huntsville AI
X-ORIGINAL-URL:https://www.hsv.ai
X-WR-CALDESC:Events for Huntsville AI
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/Chicago
BEGIN:DAYLIGHT
TZOFFSETFROM:-0600
TZOFFSETTO:-0500
TZNAME:CDT
DTSTART:20240310T080000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0500
TZOFFSETTO:-0600
TZNAME:CST
DTSTART:20241103T070000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Chicago:20240501T180000
DTEND;TZID=America/Chicago:20240501T190000
DTSTAMP:20260426T181815
CREATED:20240428T135334Z
LAST-MODIFIED:20240428T135334Z
UID:1640-1714586400-1714590000@www.hsv.ai
SUMMARY:Deep Dive with Llama-Cpp-Python
DESCRIPTION:This week we will take another look at llama-ccp\, this time using the python wrapper available in llama-cpp-python. This library can be installed and imported directly\, or run as a separate service available through the OpenAI API. \nWe covered the basics of llama-cpp last year and looked through the different quantization approaches available. It provides a great way to run a lower level model using only CPU resources and RAM. There is some quality loss due to the quantization\, but the results are good enough for prototyping at a much lower cost. \nAgenda: \n\nIntroduction to Llama-cpp-python\nInstallation and configuration\nPython API\nOpenAI API\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nSeries: \nOver the next several sessions\, we will be diving deeper into separate components needed for RAG – hopefully resulting in a chat-based Q&A service for the NASA Technical Report Server.  We were introduced to this data during our submission for the 2022 NASA SpaceApps Challenge – where we placed 2nd. Our submission was a semantic search based on the abstracts for the NSTR dataset of 10\,000 papers. \nI hope to have the video from our last session posted today. You can check for updates at https://hsv.ai/videos \nLinks: \n\nhttps://github.com/abetlen/llama-cpp-python\nhttps://llama-cpp-python.readthedocs.io/en/latest/\nHuntsville AI 2022 SpaceApps Submission – https://github.com/HSV-AI/spaceapps2022\n\n\nDetails: \n\nDate – 05/01/2024\nTime – 6-7pm\nLocation – HudsonAlpha\nAddress –  601 Genome Way Northwest\, Huntsville\, AL 35806\nZoom –https://us02web.zoom.us/j/82295484520?pwd=cU1ETGNrS3NtY1hsUmNmRVJDUmNsUT09
URL:https://www.hsv.ai/event/deep-dive-with-llama-cpp-python/
LOCATION:HudsonAlpha\, 601 Genome Way Northwest\, Huntsville\, AL\, 35806
ATTACH;FMTTYPE=image/png:https://www.hsv.ai/wp-content/uploads/2024/04/llama-cpp-python.png
END:VEVENT
END:VCALENDAR