Backpropagation from scratch

August 12, 2023 · 0 min · CohleM

Using Genetic Algorithm for Weights Optimization

BackStory This is a simple fun little project that I did almost a year ago, At that time I used to see a lot of CodeBullet’s videos and wanted to learn the gist behind these evolutionary algorithms, and I can’t get into my head if I don’t do it from scratch so I wanted to implement this project from scratch. At that time, I wanted to document the learning and the implementation process, I even thought of making a youtube video about this topic but could not complete it, at that time, I had made some video animations about this process but could not complete it because I started doing something else and when I can back it was already too much mess and could not complete the video animations, but I’ll include the video animations that I had made earlier....

August 12, 2023 · 7 min · CohleM

Fine-tuning LLM vs In-context learning

This is my experience and experimentation that I did while building a product for the use case of using LLMs for our own data for question answering. If you’re doing something similar, this could be of some help. The most commonly used methods while using LLMs with our own data were typically Fine-tuning the model with your own data Using Retrieval Augmented Generation (RAG) techniques Fine-tuning the model with your own data This is the initial method and follows the general structure of training a model...

July 22, 2023 · 5 min · CohleM