Skip to content

Commit 888e5ce

Browse files
committed
correcting typos
1 parent 9e0ab16 commit 888e5ce

File tree

8 files changed

+196
-213
lines changed

8 files changed

+196
-213
lines changed

doc/pub/week5/html/week5-bs.html

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -5315,10 +5315,7 @@ <h2 id="four-effective-ways-to-learn-an-rnn-and-preparing-for-next-week" class="
53155315
<ol>
53165316
<li> Long Short Term Memory Make the RNN out of little modules that are designed to remember values for a long time.</li>
53175317
<li> Hessian Free Optimization: Deal with the vanishing gradients problem by using a fancy optimizer that can detect directions with a tiny gradient but even smaller curvature.</li>
5318-
<li> Echo State Networks: Initialize the input a hidden and hidden-hidden and output-hidden connections very carefully so that the hidden state has a huge reservoir of weakly coupled oscillators which can be selectively driven by the input.</li>
5319-
<ul>
5320-
<li> ESNs only need to learn the hidden-output connections.</li>
5321-
</ul>
5318+
<li> Echo State Networks (ESN): Initialize the input a hidden and hidden-hidden and output-hidden connections very carefully so that the hidden state has a huge reservoir of weakly coupled oscillators which can be selectively driven by the input. ESNs only need to learn the hidden-output connections.</li>
53225319
<li> Good initialization with momentum Initialize like in Echo State Networks, but then learn all of the connections using momentum</li>
53235320
</ol>
53245321
<!-- ------------------- end of main content --------------- -->

doc/pub/week5/html/week5-reveal.html

Lines changed: 1 addition & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -5191,12 +5191,7 @@ <h2 id="four-effective-ways-to-learn-an-rnn-and-preparing-for-next-week">Four ef
51915191
<ol>
51925192
<p><li> Long Short Term Memory Make the RNN out of little modules that are designed to remember values for a long time.</li>
51935193
<p><li> Hessian Free Optimization: Deal with the vanishing gradients problem by using a fancy optimizer that can detect directions with a tiny gradient but even smaller curvature.</li>
5194-
<p><li> Echo State Networks: Initialize the input a hidden and hidden-hidden and output-hidden connections very carefully so that the hidden state has a huge reservoir of weakly coupled oscillators which can be selectively driven by the input.</li>
5195-
<ul>
5196-
5197-
<p><li> ESNs only need to learn the hidden-output connections.</li>
5198-
</ul>
5199-
<p>
5194+
<p><li> Echo State Networks (ESN): Initialize the input a hidden and hidden-hidden and output-hidden connections very carefully so that the hidden state has a huge reservoir of weakly coupled oscillators which can be selectively driven by the input. ESNs only need to learn the hidden-output connections.</li>
52005195
<p><li> Good initialization with momentum Initialize like in Echo State Networks, but then learn all of the connections using momentum</li>
52015196
</ol>
52025197
</section>

doc/pub/week5/html/week5-solarized.html

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -5220,10 +5220,7 @@ <h2 id="four-effective-ways-to-learn-an-rnn-and-preparing-for-next-week">Four ef
52205220
<ol>
52215221
<li> Long Short Term Memory Make the RNN out of little modules that are designed to remember values for a long time.</li>
52225222
<li> Hessian Free Optimization: Deal with the vanishing gradients problem by using a fancy optimizer that can detect directions with a tiny gradient but even smaller curvature.</li>
5223-
<li> Echo State Networks: Initialize the input a hidden and hidden-hidden and output-hidden connections very carefully so that the hidden state has a huge reservoir of weakly coupled oscillators which can be selectively driven by the input.</li>
5224-
<ul>
5225-
<li> ESNs only need to learn the hidden-output connections.</li>
5226-
</ul>
5223+
<li> Echo State Networks (ESN): Initialize the input a hidden and hidden-hidden and output-hidden connections very carefully so that the hidden state has a huge reservoir of weakly coupled oscillators which can be selectively driven by the input. ESNs only need to learn the hidden-output connections.</li>
52275224
<li> Good initialization with momentum Initialize like in Echo State Networks, but then learn all of the connections using momentum</li>
52285225
</ol>
52295226
<!-- ------------------- end of main content --------------- -->

doc/pub/week5/html/week5.html

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -5297,10 +5297,7 @@ <h2 id="four-effective-ways-to-learn-an-rnn-and-preparing-for-next-week">Four ef
52975297
<ol>
52985298
<li> Long Short Term Memory Make the RNN out of little modules that are designed to remember values for a long time.</li>
52995299
<li> Hessian Free Optimization: Deal with the vanishing gradients problem by using a fancy optimizer that can detect directions with a tiny gradient but even smaller curvature.</li>
5300-
<li> Echo State Networks: Initialize the input a hidden and hidden-hidden and output-hidden connections very carefully so that the hidden state has a huge reservoir of weakly coupled oscillators which can be selectively driven by the input.</li>
5301-
<ul>
5302-
<li> ESNs only need to learn the hidden-output connections.</li>
5303-
</ul>
5300+
<li> Echo State Networks (ESN): Initialize the input a hidden and hidden-hidden and output-hidden connections very carefully so that the hidden state has a huge reservoir of weakly coupled oscillators which can be selectively driven by the input. ESNs only need to learn the hidden-output connections.</li>
53045301
<li> Good initialization with momentum Initialize like in Echo State Networks, but then learn all of the connections using momentum</li>
53055302
</ol>
53065303
<!-- ------------------- end of main content --------------- -->
0 Bytes
Binary file not shown.

0 commit comments

Comments
 (0)