How to Understand Python yield lufy November 14, 2017 <p>Original link: <a title="understand yield in python" href="https://stackoverflow.com/questions/231767/what-does-the-yield-keyword-do" target="_blank">https://stackoverflow.com/questions/231767/what-does-the-yield-keyword-do</a></p> <p> </p> <p>To understand what <code>yield</code> does, you must understand what <em>generators</em> are. And before generators come <em>iterables</em>.</p> <h2>Iterables</h2> <p>When you create a list, you can read its items one by one. Reading its items one by one is called iteration:</p> <pre class="lang-py prettyprint prettyprinted"><code><span class="pun">>>></span><span class="pln"> mylist </span><span class="pun">=</span><span class="pun">[</span><span class="lit">1</span><span class="pun">,</span><span class="lit">2</span><span class="pun">,</span><span class="lit">3</span><span class="pun">]<br /></span><span class="pun">>>></span><span class="kwd">for</span><span class="pln"> i </span><span class="kwd">in</span><span class="pln"> mylist</span><span class="pun">:<br /></span><span class="pun">...</span><span class="kwd">print</span><span class="pun">(</span><span class="pln">i</span><span class="pun">)</span><span class="lit">1</span><span class="lit">2</span><span class="lit">3</span></code></pre> <p><code>mylist</code> is an <em>iterable</em>. When you use a list comprehension, you create a list, and so an iterable:</p> <pre class="lang-py prettyprint prettyprinted"><code><span class="pun">>>></span><span class="pln"> mylist </span><span class="pun">=</span><span class="pun">[</span><span class="pln">x</span><span class="pun">*</span><span class="pln">x </span><span class="kwd">for</span><span class="pln"> x </span><span class="kwd">in</span><span class="pln"> range</span><span class="pun">(</span><span class="lit">3</span><span class="pun">)]<br /></span><span class="pun">>>></span><span class="kwd">for</span><span class="pln"> i </span><span class="kwd">in</span><span class="pln"> mylist</span><span class="pun">:<br /></span><span class="pun">...</span><span class="kwd">print</span><span class="pun">(</span><span class="pln">i</span><span class="pun">)</span><span class="lit">0</span><span class="lit">1</span><span class="lit">4</span></code></pre> <p>Everything you can use "<code>for... in...</code>" on is an iterable; <code>lists</code>, <code>strings</code>, files...</p> <p>These iterables are handy because you can read them as much as you wish, but you store all the values in memory and this is not always what you want when you have a lot of values.</p> <h2>Generators</h2> <p>Generators are iterators, a kind of iterable <strong>you can only iterate over once</strong>. Generators do not store all the values in memory, <strong>they generate the values on the fly</strong>:</p> <pre class="lang-py prettyprint prettyprinted"><code><span class="pun">>>></span><span class="pln"> mygenerator </span><span class="pun">=</span><span class="pun">(</span><span class="pln">x</span><span class="pun">*</span><span class="pln">x </span><span class="kwd">for</span><span class="pln"> x </span><span class="kwd">in</span><span class="pln"> range</span><span class="pun">(</span><span class="lit">3</span><span class="pun">))<br /></span><span class="pun">>>></span><span class="kwd">for</span><span class="pln"> i </span><span class="kwd">in</span><span class="pln"> mygenerator</span><span class="pun">:<br /></span><span class="pun">...</span><span class="kwd">print</span><span class="pun">(</span><span class="pln">i</span><span class="pun">)</span><span class="lit">0</span><span class="lit">1</span><span class="lit">4</span></code></pre> <p>It is just the same except you used <code>()</code> instead of <code>[]</code>. BUT, you <strong>cannot</strong> perform <code>for i in mygenerator</code> a second time since generators can only be used once: they calculate 0, then forget about it and calculate 1, and end calculating 4, one by one.</p> <h2>Yield</h2> <p><code>yield</code> is a keyword that is used like <code>return</code>, except the function will return a generator.</p> <pre class="lang-py prettyprint prettyprinted"><code><span class="pun">>>></span><span class="kwd">def</span><span class="pln"> createGenerator</span><span class="pun">():<br /></span><span class="pun">...</span><span class="pln"> mylist </span><span class="pun">=</span><span class="pln"> range</span><span class="pun">(</span><span class="lit">3</span><span class="pun">)<br /></span><span class="pun">...</span><span class="kwd">for</span><span class="pln"> i </span><span class="kwd">in</span><span class="pln"> mylist</span><span class="pun">:<br /></span><span class="pun">...</span><span class="kwd">yield</span><span class="pln"> i</span><span class="pun">*</span><span class="pln">i </span><span class="pun">...<br /></span><span class="pun">>>></span><span class="pln"> mygenerator </span><span class="pun">=</span><span class="pln"> createGenerator</span><span class="pun">()</span><span class="com"># create a generator<br /></span><span class="pun">>>></span><span class="kwd">print</span><span class="pun">(</span><span class="pln">mygenerator</span><span class="pun">)</span><span class="com"># mygenerator is an object!<br /></span><span class="pun"><</span><span class="pln">generator object createGenerator at </span><span class="lit">0xb7555c34</span><span class="pun">><br /></span><span class="pun">>>></span><span class="kwd">for</span><span class="pln"> i </span><span class="kwd">in</span><span class="pln"> mygenerator</span><span class="pun">:<br /></span><span class="pun">...</span><span class="kwd">print</span><span class="pun">(</span><span class="pln">i</span><span class="pun">)</span><span class="lit">0</span><span class="lit">1</span><span class="lit">4</span></code></pre> <p>Here it's a useless example, but it's handy when you know your function will return a huge set of values that you will only need to read once.</p> <p>To master <code>yield</code>, you must understand that <strong>when you call the function, the code you have written in the function body does not run.</strong> The function only returns the generator object, this is a bit tricky :-)</p> <p>Then, your code will be run each time the <code>for</code> uses the generator.</p> <p>Now the hard part:</p> <p>The first time the <code>for</code> calls the generator object created from your function, it will run the code in your function from the beginning until it hits <code>yield</code>, then it'll return the first value of the loop. Then, each other call will run the loop you have written in the function one more time, and return the next value, until there is no value to return.</p> <p>The generator is considered empty once the function runs but does not hit <code>yield</code> anymore. It can be because the loop had come to an end, or because you do not satisfy an <code>"if/else"</code> anymore.</p>
Comments (0)
Leave a Comment
No comments yet. Be the first to comment!