这篇总结躺在草稿箱里一个多月
2024年经历了一个重要的事业转折点
- 人生是一场游戏
人们为自己的人生旅途中赋予了很多意义。 但其实人生的意义只在于体验, 游戏让人上瘾因为它们都有一个共同点。 快速的正反馈: 可以把人生大小小的困难设计成游戏。 分解目标, 建立正反馈系统, 。
这篇总结躺在草稿箱里一个多月
2024年经历了一个重要的事业转折点
Andre Karpathy近日在X平台上也对R1作了评价
他提出合成数据和强化学习是等价的
前一段时间
对于我来说
第一
第二
即使是天才如乔布斯
Valentine将Jobs介绍给了三个联系人
没有人单独资助了Steve
最后一个创始人的特质
2000年互联网泡沫破裂严重影响了Loudcloud的客户基础和融资环境
2001年
到2002年
回到Paul的文章
Paul在文章中提到
**最后
在OpenAI的眼中
OpenAI在上周推出了最新的模型o1-preview
很多人对o1模型能力进行了解读
o1本质上就是把思维链
这一突破意味着复杂的提示词工程(Prompt Engineering)可能会逐渐淡出舞台
简单的来说
因此
人类的物理数学大师一定程度上是不是因为他们计算能力强
A mathematician is a person who can find analogies between theorems; a better mathematician is one who can see analogies between proofs and the best mathematician can notice analogies between theories. One can imagine that the ultimate mathematician is one who can see analogies between analogies.
-—- Stefan Banach
LLM的预训练所得的是对一种简单规则的
AI大牛李沐最近回到上海交通大学做了一次演讲
李沐最后还给交大学子们指点人生迷津
以下是李沐演讲中关于技术方面的总结
当前
虽然计算能力仍在遵循摩尔定律增长
尽管面临这些挑战
目前语言模型的规模已经达到一个相对稳定的区间
语言模型正在向多模态方向发展
预训练已经逐渐变成了一个工程问题
李沐也指出了评估的重要性
李沐在演讲中多次强调了数据的重要性
尽管模型训练技术不断进步
文科白领工作是AI目前最容易替代的领域
工科白领工作
对于大多数需要与复杂物理世界互动的蓝领工作
Formal Google CEO Eric Schmidt has stirred quite a bit of controversy with his comments on Google’s work life balance, the Ukraine War, and startups strategy on pursuing growth. Putting those aside, what resonated with me was a concept brought up by the host Erik Brynjolfsson, that is general purpose technology. He said general purpose technologies are powerful because they ignite other complimentary innovations, but it usually takes process innovation or organizational innovation to fully unleash that power.
He used electricity as an example. When electricity was first introduced into factories, they didn’t become significantly more productive than the factories that were powered by steam engines.
The way steam engines worked was that there was this big steam engine sitting in the middle of the room, and power from that machine got distributed through crankshafts and pulleys to all the equipment. When they introduced electricity into factories, they would pull out the steam engine and got the biggest electric motor they could find and put it where the steam engine used to be and fired it up. But It didn’t change the production a whole lot.
It wasn’t until 30 years later that they started seeing a fundamentally different kind of factory where the giant central steam engine was replaced by many much smaller electric motors. When they started doing that, they started to have a new layout of factories. The layout was typically on a single story where the machinery was not based on how much power they needed but based on something else, like the flow of materials. And people started having these assembly line systems, which led to huge improvement in productivity. Henry Ford was one of the best examples in this revolution.
The lesson is that electricity is a fundamentally valuable technology. But it isn’t until you have that process innovation, or organizational innovation of rethinking of how to do production that you got the big payoff.
Electricity is just one example. General purpose technologies also include steam engine, railroad, mobile and information technology, etc. And in these other technologies, people had similar generational lags before they realized that this technology allowed them to do something completely different than they sued to do.
AI is bit like that in some way, there is going to be a lot of organizational innovations, new business models, new ways of organizing an economy that we haven’t thought before. Tools like ChatGPT are already making existing organizations a lot more productive. But right now we are just doing retrofitting.
It is not just technical skills that is important, it is also about rethinking other stuff. And there is a lot of opportunity for us to rethink our areas now that we’ve been given this amazing set of technologies. We have to be creative enough to think about where the gap is. And it will be even bigger once people figure out these complimentary innovations.
“I’d rather torture you into greatness than firing you.” —- Jensen Huang
On April 24th, Patrick Collison, CEO of Stripe, interviewed Jensen Huang, who is the CEO of Nvidia. Below are the main takeaways:
No One-on-One Meetings. Jensen has 60 directors who report to him, but he prefers not to have one-on-one meetings. By having all 60 directors together at once, he has eliminated at least 7 layers from the company’s structure. He believes it is more effective to communicate with all stakeholders simultaneously, allowing information to flow more efficiently among people. Everyone can contribute to and share in the information flow. Feedback is learning. Not only do you work to solve the problem at hand, but you also create conditions for others to learn from your situation. On the other hand, isn’t it a great opportunity to learn from other people’s mistakes, disasters, and strategies?
No Reports or Operational Meetings. Jensen does not have regular meetings on his schedule. At heart, he is an engineer who prefers attending meetings focused on specific problems or brainstorming sessions.
Tenure Over Hiring. Despite Nvidia’s $2 trillion valuation, it has only around 28,000 employees, whereas Microsoft, valued at $3 trillion, has over 200,000 employees. When asked about Nvidia’s efficiency, Jensen said he prioritizes tenure over hiring new people. He would rather
CUDA’s Persistence. When CUDA first launched, its lack of applications nearly crashed Nvidia’s valuation. However, Jensen deeply believed in its value and insisted on persisting. It took ten years for CUDA to become successful, without which Nvidia would not have achieved its current success in AI.
Valuing Entrepreneurs. Jensen values entrepreneurs based on three criteria:
Industrial Revolutions
Llama2’s Impact. When asked about Llama3, Jensen instead mentioned Llama2, which he considers revolutionary for activating various industries and research areas, allowing them to adopt language model techniques. He believes language encompasses more than human speech, extending to life, nature, physics, and other domains that language models can learn.
Go, the ancient board game originating from China, is not merely a game of skill but a profound exploration of strategy and decision-making. Its core concepts—such as Big Points, Frameworks, Influence, and Initiative—not only guide players to victory but also serve as metaphors for navigating life’s complexities. These principles offer invaluable insights into making better choices, anticipating outcomes, and achieving long-term success.
In Go, Big Points refer to key strategic areas on the board that yield the greatest potential gains. These points are often the first moves in a game and set the tone for future developments. Ignoring these points can lead to missed opportunities or allow opponents to gain a decisive advantage. Similarly, in life, identifying and prioritizing high-impact opportunities is essential. For example, an entrepreneur might focus on entering a fast-growing market rather than investing resources in smaller ventures. Recognizing the
A Framework in Go involves establishing a loosely defined area with a few stones that suggest potential expansion. It is a move that declares territorial ambition without committing fully, allowing room for flexibility. In Go, frameworks are crucial because they create opportunities for future growth while staking a claim in open spaces. In real life, this could translate to laying the groundwork for long-term success, such as networking in a new industry, investing in emerging technologies, or developing foundational skills. While the immediate benefits may not be clear, frameworks prepare the way for larger successes down the road.
The expansion of a framework leads to Influence, a concept in Go where stones dominate a large area, shaping the game’s dynamics without necessarily forming concrete territory. Influence is powerful because it represents potential, deterring opponents and opening strategic possibilities. In life, influence is equally intangible yet impactful. It can be seen in the reputation of a leader, the promise of an innovative idea, or the networking power of a strong connection. Although not immediately measurable, influence shifts the balance of power and creates a significant edge in competition.
In both Go and life, Critical Points often determine the outcome. These are moments or moves that demand immediate attention because they significantly affect the game’s trajectory. Winning or losing a critical point can mean the difference between control and chaos on the board. In life, these moments arise during pivotal exams, career-defining decisions, or crucial business deals. Success depends on the ability to recognize these moments, focus all efforts, and act decisively. Hesitation in these scenarios can lead to irreversible losses, whereas timely and calculated action can secure lasting advantages.
Initiative, or Sente in Go, refers to moves that force the opponent to respond, allowing the player to dictate the flow of the game. Retaining initiative is crucial for maintaining control and staying ahead in the match. In real life, initiative is about taking the lead—setting the agenda in a meeting, framing the narrative in negotiations, or introducing innovative ideas that demand attention. It empowers individuals to shape outcomes proactively rather than reactively. While taking initiative sometimes involves calculated risks, its long-term rewards often justify the effort.
Go also teaches the importance of Residual Value—or Aji, an unresolved position left on the board that can later be exploited for strategic gain. These are latent opportunities that hold potential for future use. In life, residual value appears as untapped resources, unfinished projects, or dormant relationships. Learning to recognize and preserve these assets for later leverage can provide a competitive advantage when circumstances align.
Similarly, Ko Threats in Go are moves used in negotiations during a Ko fight, where players vie for dominance in contested areas. A ko threat forces the opponent to respond, creating leverage. In real life, these threats might be social capital, intellectual property, or financial resources strategically deployed during critical negotiations. Effectively utilizing these
Finally, Playing Elsewhere, or Tenuki, is a strategic move in Go where a player abandons a local skirmish to make a more impactful move elsewhere on the board. This reflects the importance of prioritizing high-value opportunities over minor distractions. In life, tenuki teaches us to focus on what truly matters, even if it means letting go of less important tasks. It requires the discipline to avoid becoming overly attached to sunk costs and the foresight to invest in areas with greater potential.
Go’s principles remind us that success is not about immediate gains but about long-term vision, resource management, and adaptability. By understanding the importance of big points, frameworks, influence, and initiative, we can approach life’s challenges with clarity and confidence. In both Go and life, the key to mastery lies in seeing the entire board and making purposeful moves toward a meaningful goal.
最近听到一个词叫作爆米花大脑
正如哈佛大学医生Aditi Nerurkar所解释的那样
最近休息了一段时间
和好友聊到这个话题
如何拯救被忙碌和信息洪流毁掉的
第一步是真正暂时抽离
第二步是做减法
第三步是建立界限
然后我发现