←搜索结果

搜索“arXiv”

按匹配度 · 共 358 条结果 清除搜索

星期四

  1. Lilian Weng：Lil'Log

    进化策略（Evolution Strategies）解析：从简单高斯 ES 到 CMA-ES

    进化策略（ES）是一类黑盒优化算法，目标为实数向量 x∈R^n，通过采样、评估适应度、选择精英子集迭代更新分布参数 θ。最基础的 Simple-Gaussian-ES 仅跟踪均值 μ 和标准差 σ，探索尺度难以快速调整；CMA-ES 引入协方差矩阵 C 建模样本间成对依赖，并将步长 σ 与协方差解耦以加快参数更新。

    s and tuning this single parameter, WANN can discover topologies that achieve non-trivial good performance. Cited as: [1] Nikolaus Hansen. “The CMA Evolution Strategy: A Tutorial” arXiv preprint arXiv:1604.00772 (2016). [2] Marc Toussaint. Slides: “Introduction to Optimization” [3] David Ha. “A Visual Guide to Evolution Strategies” blog.otoro.net. Oct 2017. [4] Daan Wierstra, et al. “Natural evolution strategies.” IEEE World Congress on Computational Intelligence, 2008. [5] Agustinus Kristiadi.

    匹配字段正文

    #analysis#教程/实践#数据/训练

星期日

  1. Lilian Weng：Lil'Log

    Meta Reinforcement Learning：元强化学习入门 | Lil'Log

    Lilian Weng 在 Lil'Log 撰文梳理元强化学习（Meta-RL）：它把元学习用于 RL，在 MDP 分布上训练一个带记忆的循环策略，测试时无需梯度更新即可快速适应新任务。文章回顾 Hochreiter 等人 2001 年用 LSTM 做元学习、约 35 个样本即可逼近二维二次函数的工作，并介绍 Wang 等人 2016 年与 Duan 等人 2017 年（RL^2）提出的现代 Meta-RL 形式化，其策略观测额外纳入上一动作与上一奖励。

    nger, and Peter R. Conwell. “Learning to learn using gradient descent.” Intl. Conf. on Artificial Neural Networks. 2001. [3] Jane X Wang, et al. “Learning to reinforcement learn.” arXiv preprint arXiv:1611.05763 (2016). [4] Yan Duan, et al. “RL $^ 2$: Fast Reinforcement Learning via Slow Reinforcement Learning.” ICLR 2017. [5] Matthew Botvinick, et al. “Reinforcement Learning, Fast and Slow” Cell Review, Volume 23, Issue 5, P408-422, May 01, 2019. [6] Jeff Clune. “AI-GAs: AI-generating algorithm

    匹配字段正文

    #analysis#教程/实践#推理#数据/训练

星期日

  1. Lilian Weng：Lil'Log

    Lilian Weng 详解面向 Sim2Real 迁移的域随机化

    域随机化（DR）通过在仿真器中随机化视觉与物理动力学参数（如物体位置、材质纹理、光照、质量、摩擦、阻尼、关节限位、动作延迟和观测噪声），让策略在丰富分布上训练后迁移到真实环境。相比需要真实数据的域适应，DR 几乎不需要真实样本；OpenAI Robotics 借此让灵巧手连续旋转物体至 50 个随机目标朝向。

    rring deep neural networks from simulation to the real world.” IROS, 2017. [2] Fereshteh Sadeghi and Sergey Levine. “CAD2RL: Real single-image flight without a single real image.” arXiv:1611.04201 (2016). [3] Xue Bin Peng, et al. “Sim-to-real transfer of robotic control with dynamics randomization.” ICRA, 2018. [4] Nataniel Ruiz, et al. “Learning to Simulate.” ICLR 2019 [5] OpenAI. “Learning Dexterous In-Hand Manipulation.” arXiv:1808.00177 (2018). [6] OpenAI Blog. “Learning dexterity” July 30,

    匹配字段正文

    #analysis#教程/实践#具身智能#数据/训练

星期四

  1. Lilian Weng：Lil'Log

    深度神经网络真的严重过拟合了吗？| Lil'Log

    Lilian Weng 在 Lil'Log 撰文探讨深度神经网络为何在参数极多、训练误差可轻易趋近于零的情况下仍能泛化，并梳理了奥卡姆剃刀、最小描述长度（MDL）原理与 Kolmogorov 复杂度等经典理论。文章还讨论了双层神经网络有限样本表达能力、深度网络可学习随机噪声，并于 2019-05-27 补充了 Lottery Ticket Hypothesis 一节。

    i Santurkar, et al. “How does batch normalization help optimization?.” NIPS 2018. [7] Mikhail Belkin, et al. “Reconciling modern machine learning and the bias-variance trade-off.” arXiv:1812.11118, 2018. [8] Chiyuan Zhang, et al. “Are All Layers Created Equal?” arXiv:1902.01996, 2019. [9] Chunyuan Li, et al. “Measuring the intrinsic dimension of objective landscapes.” ICLR 2018. [10] Jonathan Frankle and Michael Carbin. “The lottery ticket hypothesis: Finding sparse, trainable neural networks.”

    匹配字段正文

    #analysis#论文/研究#数据/训练

星期四

  1. Lilian Weng：Lil'Log

    Lilian Weng 综述广义语言模型：从 CoVe、ELMo 到 GPT-2、BERT

    Lilian Weng 在 Lil'Log 发布《Generalized Language Models》综述，梳理了让词嵌入依赖上下文并更易迁移到下游任务的各类方法。文章从 CoVe 的 NMT 编码器上下文词向量讲起，重点介绍 ELMo 通过无监督双向语言模型（biLM）预训练学习上下文表示，并指出 OpenAI GPT 与 BERT 进一步用无监督预训练加生成式架构同时克服 CoVe 的局限。该文后续陆续补充了 ULMFiT、GPT-2、ALBERT、RoBERTa、T5、GPT-3、XLNet、BART 和 ELECTRA。

    Understanding by Generative Pre-Training”. OpenAI Blog, June 11, 2018. [8] Jacob Devlin, et al. “BERT: Pre-training of deep bidirectional transformers for language understanding.” arXiv:1810.04805 (2018). [9] Mike Schuster, and Kaisuke Nakajima. “Japanese and Korean voice search.” ICASSP. 2012. [11] Ashish Vaswani, et al. “Attention is all you need.” NIPS 2017. [12] Peter J. Liu, et al. “Generating wikipedia by summarizing long sequences.” ICLR 2018. [13] Sebastian Ruder. “10 Exciting Ideas of 2

    匹配字段正文

    #analysis#教程/实践#数据/训练#OpenAI

星期五

  1. Lilian Weng：Lil'Log

    元学习：如何让模型学会快速学习 | Lil'Log

    Lil'Log 这篇文章系统梳理了元学习（learning to learn）的问题定义与主要方法，目标是让模型在少量训练样本下快速适应新任务。文章将常见方法归纳为基于度量、基于模型和基于优化三类，并介绍了 few-shot 分类中支持集与预测集的划分，以及 learner 与 meta-learner 两阶段更新框架。

    ” CVPR. 2018. [7] Adam Santoro, et al. “Meta-learning with memory-augmented neural networks.” ICML. 2016. [8] Alex Graves, Greg Wayne, and Ivo Danihelka. “Neural turing machines.” arXiv preprint arXiv:1410.5401 (2014). [9] Tsendsuren Munkhdalai and Hong Yu. “Meta Networks.” ICML. 2017. [10] Sachin Ravi and Hugo Larochelle. “Optimization as a Model for Few-Shot Learning.” ICLR. 2017. [11] Chelsea Finn’s BAIR blog on “Learning to Learn”. [12] Chelsea Finn, Pieter Abbeel, and Sergey Levine. “Model-

    匹配字段正文

    #analysis#教程/实践#数据/训练

星期六

  1. Lilian Weng：Lil'Log

    Flow-based 深度生成模型：归一化流与密度估计

    Flow-based 深度生成模型通过归一化流（normalizing flows）显式学习数据分布 p(x)，损失函数就是负对数似然，与 GAN、VAE 不同。它由一系列可逆变换构成，借助变量替换定理和 Jacobian 行列式，把简单分布逐步变换为复杂分布，从而支持数据生成、密度估计、隐变量推断和缺失数据填补等任务。

    : Non-linear independent components estimation.” ICLR 2015 Workshop track. [7] Diederik P. Kingma, and Prafulla Dhariwal. “Glow: Generative flow with invertible 1x1 convolutions.” arXiv:1807.03039 (2018). [8] Germain, Mathieu, Karol Gregor, Iain Murray, and Hugo Larochelle. “Made: Masked autoencoder for distribution estimation.” ICML 2015. [9] Aaron van den Oord, Nal Kalchbrenner, and Koray Kavukcuoglu. “Pixel recurrent neural networks.” ICML 2016. [10] Diederik P. Kingma, et al. “Improved varia

    匹配字段正文

    #analysis#教程/实践#数据/训练

星期日

  1. Lilian Weng：Lil'Log

    从 Autoencoder 到 Beta-VAE：Lil'Log 详解自编码器家族

    Lil'Log 这篇长文梳理了从 Autoencoder 到 Beta-VAE 的自编码器演进脉络，涵盖 Denoising Autoencoder、Sparse Autoencoder 与 k-Sparse Autoencoder 等变体，并先后补充了 VQ-VAE、VQ-VAE-2 和 TD-VAE 章节。文章指出自编码器通过编码器与解码器学习恒等映射，在压缩数据的同时获得可用于搜索、数据压缩或揭示生成因子的低维嵌入向量。

    Geoffrey E. Hinton, Nitish Srivastava, Alex Krizhevsky, Ilya Sutskever, and Ruslan R. Salakhutdinov. “Improving neural networks by preventing co-adaptation of feature detectors.” arXiv preprint arXiv:1207.0580 (2012). [5] Sparse Autoencoder by Andrew Ng. [6] Alireza Makhzani, Brendan Frey (2013). “k-sparse autoencoder”. ICLR 2014. [7] Salah Rifai, et al. “Contractive auto-encoders: Explicit invariance during feature extraction.” ICML, 2011. [8] Diederik P. Kingma, and Max Welling. “Auto-encodin

    匹配字段正文

    #analysis#教程/实践#数据/训练

星期日

  1. Lilian Weng：Lil'Log

    Attention? Attention!：注意力机制如何解决 Seq2Seq 长句遗忘问题

    Lilian Weng 在 Lil'Log 撰文解释注意力机制：seq2seq 模型把输入压缩成固定长度上下文向量，处理长句时容易遗忘前文，Bahdanau 等人 2015 年提出的注意力机制在上下文向量与整个源输入之间建立可定制的捷径连接，让源与目标的对齐由上下文向量学习控制。文中给出注意力权重的数学定义，并指出对齐分数矩阵可显式展示源词与目标词的相关性。

    iaolong Wang, et al. “Non-local Neural Networks.” CVPR 2018 [11] Han Zhang, Ian Goodfellow, Dimitris Metaxas, and Augustus Odena. “Self-Attention Generative Adversarial Networks.” arXiv preprint arXiv:1805.08318 (2018). [12] Nikhil Mishra, Mostafa Rohaninejad, Xi Chen, and Pieter Abbeel. “A simple neural attentive meta-learner.” ICLR 2018. [13] “WaveNet: A Generative Model for Raw Audio” - Sep 8, 2016 by DeepMind. [14] Oriol Vinyals, Meire Fortunato, and Navdeep Jaitly. “Pointer networks.” NIPS

    匹配字段正文

    #analysis#教程/实践#推理

星期日

  1. Lilian Weng：Lil'Log

    策略梯度算法详解 | Lil'Log

    Lil'Log 发布《策略梯度算法》一文，系统讲解策略梯度这一强化学习求解思路：直接对参数化策略 πθ(a|s) 建模并优化，用梯度上升最大化奖励目标 J(θ)。文章给出策略梯度定理的完整证明，说明它如何避开状态分布 dπ(.) 的导数、简化 ∇θJ(θ) 的计算，并指出原始策略梯度更新无偏但方差高，后续算法多围绕降方差展开。

    CML. 2016. [7] David Silver, et al. “Deterministic policy gradient algorithms.” ICML. 2014. [8] Timothy P. Lillicrap, et al. “Continuous control with deep reinforcement learning.” arXiv preprint arXiv:1509.02971 (2015). [9] Ryan Lowe, et al. “Multi-agent actor-critic for mixed cooperative-competitive environments.” NIPS. 2017. [10] John Schulman, et al. “Trust region policy optimization.” ICML. 2015. [11] Ziyu Wang, et al. “Sample efficient actor-critic with experience replay.” ICLR 2017. [12] R

    匹配字段正文

    #analysis#教程/实践#推理

星期一

  1. Lilian Weng：Lil'Log

    深入浅出强化学习：Lilian Weng 的 RL 入门长文

    Lilian Weng 在 Lil'Log 发布了一篇强化学习入门长文，从智能体与环境交互出发，系统梳理了状态、动作、奖励、策略、价值函数等核心概念，并区分 model-based 与 model-free、on-policy 与 off-policy 等算法类别。文章以 AlphaGo、AlphaGo Zero 和 OpenAI DOTA2 1v1 机器人等案例引入，面向新手作为进一步研究前沿工作的起点。

    in this post, don’t hesitate to contact me at [lilian dot wengweng at gmail dot com]. See you in the next post! :) Cited as: [1] Yuxi Li. Deep reinforcement learning: An overview. arXiv preprint arXiv:1701.07274. 2017. [2] Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction; 2nd Edition. 2017. [3] Volodymyr Mnih, et al. Asynchronous methods for deep reinforcement learning. ICML. 2016. [4] Tim Salimans, et al. Evolution strategies as a scalable alternative to reinforcem

    匹配字段正文

    #analysis#教程/实践#数据/训练

星期日

  1. Lilian Weng：Lil'Log

    面向初学者的目标检测 Part 3：R-CNN 家族 | Lil'Log

    Lilian Weng 在“Object Detection for Dummies”系列第三篇中梳理了 R-CNN（Region-based CNN）家族：R-CNN 先用 selective search 为每张图提出约 2k 个候选区域，再对每个区域单独提取 CNN 特征做分类。文章还介绍了边界框回归、非极大值抑制与难负样本挖掘等常用技巧，并指出 R-CNN 训练慢的瓶颈，引出将三个模型统一联合训练的 Fast R-CNN。

    proposal networks.” In Advances in neural information processing systems (NIPS), pp. 91-99. 2015. [4] Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. “Mask R-CNN.” arXiv preprint arXiv:1703.06870, 2017. [5] Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. “You only look once: Unified, real-time object detection.” In Proc. IEEE Conf. on computer vision and pattern recognition (CVPR), pp. 779-788. 2016. [6] “A Brief History of CNNs in Image Segmentation: From R-CNN t

    匹配字段正文

    #analysis#教程/实践#图像生成

星期五

  1. Lilian Weng：Lil'Log

    面向初学者的目标检测（第二部分）：CNN、DPM 与 Overfeat

    Lilian Weng 的“Object Detection for Dummies”系列第二部分梳理了图像分类的经典卷积网络：AlexNet（5 个卷积层 + 2 个 MLP 层 + 1 个 LR 层）、19 层的 VGG 和 152 层的 ResNet，并介绍了 mAP 评测指标。文章还讲解了基于可变形部件混合图模型的 DPM，以及把检测、定位与分类整合进同一 CNN 的 Overfeat。

    n and sufficient confidence of being the same object from the classifier Cited as: [1] Vincent Dumoulin and Francesco Visin. “A guide to convolution arithmetic for deep learning.” arXiv preprint arXiv:1603.07285 (2016). [2] Haohan Wang, Bhiksha Raj, and Eric P. Xing. “On the Origin of Deep Learning.” arXiv preprint arXiv:1702.07800 (2017). [3] Pedro F. Felzenszwalb, Ross B. Girshick, David McAllester, and Deva Ramanan. “Object detection with discriminatively trained part-based models.” IEEE tran

    匹配字段正文

    #analysis#教程/实践#图像生成#数据/训练

星期日

  1. Lilian Weng：Lil'Log

    词嵌入学习：从计数模型到 skip-gram 与 CBOW

    Lilian Weng 在 Lil'Log 中梳理了词嵌入的两类学习方法：基于全局共现矩阵分解的计数模型，以及用局部上下文预测目标词的上下文模型。文章以 skip-gram 为例说明训练样本的构造方式，并介绍了 CBOW 模型与全 softmax、层次 softmax 等损失计算方法。

    . [4] Xin Rong. word2vec Parameter Learning Explained [5] Mikolov, Tomas, Kai Chen, Greg Corrado, and Jeffrey Dean. “Efficient estimation of word representations in vector space.” arXiv preprint arXiv:1301.3781 (2013). [6] Frederic Morin and Yoshua Bengio. “Hierarchical Probabilistic Neural Network Language Model.” Aistats. Vol. 5. 2005. [7] Michael Gutmann and Aapo Hyvärinen. “Noise-contrastive estimation: A new estimation principle for unnormalized statistical models.” Proc. Intl. Conf. on Art

    匹配字段正文

    #analysis#教程/实践#数据/训练

星期四

  1. Lilian Weng：Lil'Log

    用信息论剖析深度学习：信息瓶颈方法 | Lil'Log

    Naftali Tishby 提出用信息瓶颈（IB）方法研究深度神经网络训练，认为 DNN 训练分为两个阶段：先充分表示输入数据以最小化泛化误差，再压缩表示、遗忘与目标无关的细节。由于参数数量指数级增长，传统学习理论失效，他据此提出了新的学习界。

    Naftali Tishby. Information Theory of Deep Learning [2] Machine Learning Theory - Part 1: Introduction [4] New Theory Cracks Open the Black Box of Deep Learning by Quanta Magazine. [5] Naftali Tishby and Noga Zaslavsky. “Deep learning and the information bottleneck principle.” IEEE Information Theory Workshop (ITW), 2015. [6] Ravid Shwartz-Ziv and Naftali Tishby. “Opening the Black Box of Deep Neural Networks via Information.” arXiv preprint arXiv:1703.00810, 2017. Information-Theory; Foundation

    匹配字段正文

    #analysis#论文/研究#数据/训练

星期日

  1. Lilian Weng：Lil'Log

    从 GAN 到 WGAN：Lil'Log 解析生成对抗网络的数学原理与训练难题

    Lilian Weng 在 Lil'Log 撰文解析 GAN 的数学原理：判别器最优值为 p_r(x)/(p_r(x)+p_g(x))，当生成分布等于真实分布时该值为 1/2，此时 GAN 损失函数等价于 JS 散度，最优损失为 -2log2。文章随后讨论 GAN 训练中的纳什均衡难达成、梯度消失、模式崩溃等问题，并引入 Wasserstein GAN（WGAN）作为改进方案。

    Example: Create New Pokemons!; References [Updated on 2018-09-30: thanks to Yoonju, we have this post translated in Korean!] [Updated on 2019-04-18: this post is also available on arXiv.] Generative adversarial network (GAN) has shown great results in many generative tasks to replicate the real-world rich content such as images, human language, and music. It is inspired by game theory: two models, a generator and a critic, are competing with each other while making each other stronger at the sam

    匹配字段正文

    #analysis#教程/实践#数据/训练

星期二

  1. Lilian Weng：Lil'Log

    如何解释机器学习模型的预测？| Lil'Log

    Lilian Weng 在 Lil'Log 撰文梳理机器学习模型的可解释性方法，从线性回归、朴素贝叶斯、决策列表到随机森林等本身可解释的模型入手。文章引用 Lipton (2017) 提出的可模拟性、算法透明性与可分解性三项标准，并以金融放贷、医疗诊断、司法再犯预测和自动驾驶等场景说明解释模型决策的必要性。

    very day. Hope my post can give you some pointers and encourage you to investigate more into this topic :) Cited as: [1] Zachary C. Lipton. “The mythos of model interpretability.” arXiv preprint arXiv:1606.03490 (2016). [2] Been Kim, Rajiv Khanna, and Oluwasanmi O. Koyejo. “Examples are not enough, learn to criticize! criticism for interpretability.” Advances in Neural Information Processing Systems. 2016. [3] Himabindu Lakkaraju, Stephen H. Bach, and Jure Leskovec. “Interpretable decision sets:

    匹配字段正文

    #analysis#教程/实践#推理

星期三

  1. Lilian Weng：Lil'Log

    面向好奇者的深度学习概览：从 AlphaGo 到 CNN 与 RNN

    Lilian Weng 在 WiMLDS x Fintech meetup 演讲整理的文章中，以 2016 年 AlphaGo 以 1-4 击败九段李世石为引，解释深度学习为何在当下兴起：数据量大幅增长与算力显著提升，使深层神经网络能自动学习复杂非线性特征。文章随后介绍了 CNN（受视觉皮层 V1/V2/V4 启发，含 Residual Net）与 RNN 两类经典模型及其在语音识别、机器翻译等任务中的应用。

    ed 1-2 years ago. Reading academic papers can help you learn stuff in depth and keep up with the cutting-edge findings. Useful resources Google Scholar: http://scholar.google.com; arXiv cs section: https://arxiv.org/list/cs/recent; Unsupervised Feature Learning and Deep Learning Tutorial; Tensorflow Tutorials; Data Science Weekly; KDnuggets; Tons of blog posts and online tutorials; Related Cousera courses; awesome-deep-learning-papers Blog posts mentioned Interesting blogs worthy of checking www

    匹配字段正文

    #analysis#教程/实践#数据/训练