The introduction of ChatGPT and LLMs has accelerated neural NLP research, but these models require large computing resources, and state-of-the-art models are locked behind paywalls, limiting access for researchers. This talk, titled "A Guide into Open-Source Large Language Models and Fine-Tuning Techniques," will provide background on using LLaMa-2 and other open-source models; discuss technologies that make LLMs more accessible; and touch on fine-tuning models for specific domains.