Information Theory

Information Theory and Source coding

I was going through my dropbox and found some of my old notes on information theory, till this day I think I still love these notes. 🙂 I. Introduction to information theory, Information theory: Fundamental Limits of communication Coding Techniques: Concerned with practical techniques to realise the limits specified by information theory Uncertainty:“More the uncertainty of the …

Continue Reading
Vaguely Related to Python

What heartbreak with ULMFiT feels like?

Originally posted I have a substack newsletter, check it out? Contents What is ULMFiT? How to use ULMFiT? How it broke my heart What is ULMFiT? Universal Language Model Fine-tuning for Text Classification Inductive transfer learning has greatly impacted computer vision, but existing approaches in NLP still require task-specific modifications and training from scratch. We …

Continue Reading
Vaguely Related to ETC

Cyber Security

Cybercrime may emerge from local, remote, domestic or foreign sources. Security Breach A security breach is defined as leakage of information, digital data that’s supposed to be private to a person. Whenever this data is compromised, due to malicious or accidental attack the integrity of the data is compromised. Privacy Key Dimensions Informational privacy Personal …

Continue Reading