Skip to content

Commit 3aa6984

Browse files
committed
update
1 parent fcbe09a commit 3aa6984

16 files changed

Lines changed: 2126 additions & 2565 deletions

File tree

1.51 MB
Binary file not shown.
0 Bytes
Binary file not shown.
274 Bytes
Binary file not shown.

doc/LectureNotes/_build/html/_sources/week38.ipynb

Lines changed: 129 additions & 127 deletions
Large diffs are not rendered by default.

doc/LectureNotes/_build/html/searchindex.js

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

doc/LectureNotes/_build/html/week38.html

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -452,9 +452,10 @@ <h2>Plans for week 38, lecture Monday September 15<a class="headerlink" href="#p
452452
<li><p>Statistical interpretation of OLS and various expectation values</p></li>
453453
<li><p>Resampling techniques, Bootstrap and cross validation and bias-variance tradeoff</p></li>
454454
<li><p>The material we did not cover last week, that is on more advanced methods for updating the learning rate, are covered by its own video. We will briefly discuss these topics at the beginning of the lecture and during the lab sessions. See video on ADAgrad, RMSprop and ADAM (material from last week not covered during lecture) at <a class="reference external" href="https://youtu.be/J_41Hld6tTU">https://youtu.be/J_41Hld6tTU</a></p></li>
455+
<li><p><a class="reference external" href="https://youtu.be/4Fo7ITVA7V4">Video of Lecture</a></p></li>
456+
<li><p><a class="reference external" href="https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2025/FYSSTKweek38.pdf">Whiteboard notes</a></p></li>
455457
</ol>
456-
<!-- * [Video of Lecture](https://youtu.be/omLmp_kkie0) -->
457-
<!-- * [Whiteboard notes](https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2024/NotesSeptember9.pdf) --></section>
458+
</section>
458459
<section id="readings-and-videos">
459460
<h2>Readings and Videos<a class="headerlink" href="#readings-and-videos" title="Link to this heading">#</a></h2>
460461
<ol class="arabic simple">
@@ -684,12 +685,12 @@ <h2>A new Cost Function<a class="headerlink" href="#a-new-cost-function" title="
684685
<p>We could now define a new cost function to minimize, namely the negative logarithm of the above PDF</p>
685686
<div class="math notranslate nohighlight">
686687
\[
687-
C(\boldsymbol{\theta}=-\log{\prod_{i=0}^{n-1}p(y_i,\boldsymbol{X}\vert\boldsymbol{\theta})}=-\sum_{i=0}^{n-1}\log{p(y_i,\boldsymbol{X}\vert\boldsymbol{\theta})},
688+
C(\boldsymbol{\theta})=-\log{\prod_{i=0}^{n-1}p(y_i,\boldsymbol{X}\vert\boldsymbol{\theta})}=-\sum_{i=0}^{n-1}\log{p(y_i,\boldsymbol{X}\vert\boldsymbol{\theta})},
688689
\]</div>
689690
<p>which becomes</p>
690691
<div class="math notranslate nohighlight">
691692
\[
692-
C(\boldsymbol{\theta}=\frac{n}{2}\log{2\pi\sigma^2}+\frac{\vert\vert (\boldsymbol{y}-\boldsymbol{X}\boldsymbol{\theta})\vert\vert_2^2}{2\sigma^2}.
693+
C(\boldsymbol{\theta})=\frac{n}{2}\log{2\pi\sigma^2}+\frac{\vert\vert (\boldsymbol{y}-\boldsymbol{X}\boldsymbol{\theta})\vert\vert_2^2}{2\sigma^2}.
693694
\]</div>
694695
<p>Taking the derivative of the <em>new</em> cost function with respect to the parameters <span class="math notranslate nohighlight">\(\theta\)</span> we recognize our familiar OLS equation, namely</p>
695696
<div class="math notranslate nohighlight">

0 commit comments

Comments
 (0)