SwissCloudDay2023Philikai

Repository for references, further reading material and code snippets.

Parameter Efficient Fine Tuning

Some more reading on LoRa Adapters:

• Dive into LoRa Adapters
• Conceptual Guide of HuggingFace for LoRa
• Original Paper on LoRa - LoRA: Low-Rank Adaptation of Large Language Models

Jumpstart on SageMaker:

• Llama 2 foundation models from Meta are now available in Amazon SageMaker JumpStart
• Fine-tune Llama 2 for text generation on Amazon SageMaker JumpStart

Huggingface and SageMaker:

• Notebooks

Inferentia on SageMaker:

• PyTorch Neuron (torch-neuronx) Samples for AWS Trn1/Trn1n & Inf2 Instances