LLM Post-Training experience
Prompt Prompt is the most direct way to influence response, tips for good prompt: Clear instruction about our demand Provide necessary context, role, tone, format guide LLM output reasoning ...
Prompt Prompt is the most direct way to influence response, tips for good prompt: Clear instruction about our demand Provide necessary context, role, tone, format guide LLM output reasoning ...
Summary Methods There are two main methods to acclerate LLM and another tricky methods low-rank: reduce dimension of matrix block: compute matrix with block trick: update model structure o...
Previous Plan My first blog was summary of 2021, that is the start of the blog, it’s a little hard to believe that I write this blog for five years, I like this feeling. See back the plan of 2025...
Why kindle is better I usualy read kindle on the bed before I fall asleep, I think the big advantage of reading kindle is that kindle leads less distractions. When I use computer and browser the w...
Project The last month goes fast, because I almost spned all my last month into a new project. Right now, I finish the first relative muture version of the project. Of course, I still realize some...
English proficiency I though I can improve my english ability after staying in english speaking country for some time naturally, this is definitely wrong. English proficiency can be imporved only ...
In short, Target of fraud detection is to detect fradulent traffic and filtering or block them. What mekes this interesting and difficult are what we are detecting are human, it might be as hard as...
Introduction PopTranslate is a translation chrome extension, main features: Pop up translated contents immediately after selecting contents without extra click Show english dictionary when sel...
Today is the last day for me in netease, I don’t much as much feeling as that in baidu, on the one hand, I spend much more time in baidu, almose five days, one the other hand, that’s my first job, ...
Copilot-typed GitHub Copilot, cursor, GPT-codex, winsurf, trae are representative products of Copilot-typed tools, their function is to help users complete code automatically when necessary. Of cou...