This website is a virtual proof that I'm awesome https://tono-vacn.github.io/ A collection of notes and references on Mlsys - Mlsys Memo Mlsys Memo DNN Architecture MLP: Dense Pattern Processing CNN: Spatial Pattern Processing RNN: Sequential Pattern Processing Transformer: Dynamic Pattern Processing Modern DL, computational graph, autodiff, frameworks DL Computation DL Workloads Most important components in CNN Most important components in RNN Most important components in Transformer Most important components... Sun, 23 Mar 2025 00:00:00 -0400 https://tono-vacn.github.io/2025-03-23-mlsys/ https://tono-vacn.github.io/2025-03-23-mlsys/ Notes for data-intensive applications - A simple note for data-intensive applications. From Designing Data-Intensive Applications by Martin Kleppmann Data Replication leader-based replication: leader-based replication implementation Problems with Replication Lag Multi-Leader Replication Use Cases for Multi-Leader Replication Handling Write Conflicts Conflict avoidance Converging toward a consistent state Custom conflict resolution logic Automatic Conflict Resolution Multi-Leader Replication... Sun, 26 Jan 2025 00:00:00 -0500 https://tono-vacn.github.io/2025-01-26-data-intensive/ https://tono-vacn.github.io/2025-01-26-data-intensive/ Notes for system design - A simple note for system design. From System Design Interview Volume 2 by Alex Xu Proximity Service Basic requirements functional Return all businesses based on a user’s location (latitude and longitude pair) and radius. Business owners can add, delete or update a business, but this information doesn’t need to be... Sat, 25 Jan 2025 00:00:00 -0500 https://tono-vacn.github.io/2025-01-25-system-design-notes-two/ https://tono-vacn.github.io/2025-01-25-system-design-notes-two/ Notes for Generative AI Class - SafeDecoding background Jailbreak Attacks two main classes: empirical jailbreak attacks and optimization-based adversarial attacks empirical jailbreak attacks prompt engineering root causes: competing objectives: llm need to balance helpfulness and safety, but the two objectives are not aligned generalization mismatch: llm did not generalize well to unseen prompts hypnotized to generate... Mon, 13 Jan 2025 00:00:00 -0500 https://tono-vacn.github.io/2025-01-13-genai-memo/ https://tono-vacn.github.io/2025-01-13-genai-memo/ Notes for system design - A simple note for system design. From System Design Interview by Alex Xu K-V Store Design scopes CAP Theorem System Components Unique ID Generator Requirements Probable solutions Multi-master replication UUID Ticket server Snowflake Furhter problems URL Shortener API Design Redirecting Shortening Possible process Web Crawler Possible Requirements High-level design Pick... Mon, 30 Dec 2024 00:00:00 -0500 https://tono-vacn.github.io/2024-12-30-system-design-notes/ https://tono-vacn.github.io/2024-12-30-system-design-notes/ Try to do it in parallel - Introduction This is a note for parallel programming, including OpenMP, Pthread, and MPI. Table of Contents Introduction Table of Contents Loop Transformation Performancs Primer Data Dependency Loop-independent and Loop-carried Dependence ITG and LDG Loop Optimization Loop Invariant Hoisting Loop Unrolling Loop Fusion Loop Fission Loop Peeling Loop Unswitching Loop Interchange... Tue, 12 Nov 2024 00:00:00 -0500 https://tono-vacn.github.io/2024-11-12-parallel-programming-memo/ https://tono-vacn.github.io/2024-11-12-parallel-programming-memo/ Something you really need to know - Introduction This is a note for some basic concepts in distributed system. Table of Contents Introduction Table of Contents RPC Key Points Primary-Backup Replication Failure model Replicate Methods State transfer Replicated state machine Replication Layer Choice Virtual Machine Why Virtual Machine? Design Details How it runs with no failure Logging... Mon, 11 Nov 2024 00:00:00 -0500 https://tono-vacn.github.io/2024-11-11-common-sense-for-distributed-system/ https://tono-vacn.github.io/2024-11-11-common-sense-for-distributed-system/ Prepare for midterm - Table of Contents Table of Contents Overview of Swift More on Swift SwiftData MVC and MVVM PersistentStorage Communication Other Concepts SwiftUI Graphics and Animation Overview of Swift single line of declaration: var x = 0.0, y = 0.0, z = 0.0 var red, green, blue: Double multiline comments: Unlike multiline... Sat, 19 Oct 2024 00:00:00 -0400 https://tono-vacn.github.io/2024-10-19-swift-review/ https://tono-vacn.github.io/2024-10-19-swift-review/ Never tasted it before - Introduction This article is a simple report to discuss the feasibility of using Swift to set up a backend server. We will list some frameworks and tools that can be used to build a backend server with Swift. For different components of a backend server, we will also compare the... Mon, 30 Sep 2024 00:00:00 -0400 https://tono-vacn.github.io/2024-09-30-swift-for-backend/ https://tono-vacn.github.io/2024-09-30-swift-for-backend/ How to compress PNG in user's browser - Introduction This article is a simple guide for 2 different ways for PNG image compresson: reducing color channels with pixel dithering or converting them to WebP format. Here we will discuss some details about 2 different methods and the way to implement them in a web application. 1. Overview of... Wed, 25 Sep 2024 00:00:00 -0400 https://tono-vacn.github.io/2024-09-25-browser-side-image-compression/ https://tono-vacn.github.io/2024-09-25-browser-side-image-compression/ Lower coupling in Backend Services - Introduction As digital demands escalate, backend systems must evolve to manage both immediate and delayed operations effectively. Decoupling REST APIs from long-running task modules is key to boosting system performance and scalability. Imagine a scenario where a REST API receives a request to call a ai agent(probably with LLM embedded)... Thu, 15 Aug 2024 00:00:00 -0400 https://tono-vacn.github.io/2024-08-15-decoupling-restapi-response-module-and-long-running-task-execution-module/ https://tono-vacn.github.io/2024-08-15-decoupling-restapi-response-module-and-long-running-task-execution-module/ Some Rust notes - 内存管理：所有权&移动 所有权 丢弃/drop： Rust会自动调用drop函数来释放内存。 变量离开作用域时，Rust会自动调用drop函数来释放内存。 单一拥有者规则 每个值都有一个所有者 值只能有一个所有者 当所有者离开作用域时，值会被释放 所有权树：值拥有者及其所拥有的值形成了一棵树 值的拥有者是值的父节点 值拥有的值是子节点 总根都是一个变量，当该变量离开作用域时，树上的所有值都会被释放 单一拥有者规则确保排列不可能比树更复杂 基于这些严格限制的扩展： 拥有者可以转移：对树形结构进行拆解、重构建 存在基本的Copy类型，类似值拷贝 提供引用计数指针Rc和Arc，实现多拥有者 可以进行借用（borrow），即引用，获得非拥有型指针 移动 移动（move）：“源会把值的所有权转移给目标并变回未初始化状态，改由目标变量来控制值的生命周期。” Rust禁止使用未初始化值 常见的移动： 从函数返回：Vec::new()返回一个Vec，所有权转移到左值 函数参数传递：fn foo(v: Vec<i32>)，所有权转移到函数参数 构造新值：to_string()，所有权转移到新值 循环获得所有权 for循环：for ... in v会将所有权移出v 循环时v会对代码不可见 Copy Copy类型：实现了Copy trait的类型 整数、浮点、char、bool Copy类型的元组 固定size的数组 任何丢弃值时需要特殊操作的都不是Copy类型 String不是Copy类型 默认的Struct和Enum不是Copy类型 通过放置#[derive(Copy, Clone)]来实现Copy trait，对于只拥有Copy类型的字段的Struct和Enum Rc和Arc Rc：Reference Counted，引用计数 允许多个所有者... Tue, 23 Jan 2024 00:00:00 -0500 https://tono-vacn.github.io/2024-01-23-rust-memo/ https://tono-vacn.github.io/2024-01-23-rust-memo/