good morning everyone, drinking coffee with syrniki and strawberries.
All notes
我在中国是一个准脱离政府掌控者,基于身份的一切活动我都不参与,比如正式工作和网购。我也为此付出巨大代价,我的选择空间被极大压缩,行动能力损失严重。我只能通过少量免费wifi访问互联网
In China, I am practically independent of the government; I don't participate in any activities based on my status, such as formal work or online shopping. I've paid a heavy price for this; my choices have been severely limited, and my mobility has been significantly impaired. I can only access the internet through limited free Wi-Fi.
中国的开源模型在最高意志的主导下,在预训练数据阶段,就筛除大量对其不利的内容,sft阶段构建的数据掺入大量替其辩护的内容。急需一个纠偏数据集用于微调
Under the overarching influence of a single, powerful force, China's open-source models filter out a large amount of content unfavorable to their designs during the pre-training stage, and then incorporate a significant amount of content defending their designs into the data constructed during the SFT stage. A corrective dataset is urgently needed for fine-tuning.
