Skip to main content

Generators in Python

 


Learning Sections          show

Generators in Python

Generators are a special type of iterator in Python that allow you to iterate over a sequence of items without storing them all in memory at once. They are useful for generating large sequences of data on-the-fly, or for processing data in a memory-efficient manner.

Creating Generators

In Python, generators are created using generator functions or generator expressions:


# Generator function
def my_generator(n):
    for i in range(n):
        yield i

# Generator expression
my_generator = (i for i in range(10))

A generator function uses the yield keyword to yield values one at a time, while a generator expression creates an anonymous generator.

Iterating Over Generators

You can iterate over the values produced by a generator using a for loop:


for value in my_generator(5):
    print(value)

This will print the values generated by the generator function.

Generator Expressions

Generator expressions are similar to list comprehensions, but they produce values lazily as they are needed:


# Generator expression
squares = (x**2 for x in range(10))

# Iterate over the generator expression
for square in squares:
    print(square)

This will print the squares of numbers from 0 to 9.

Benefits of Generators
  • Memory Efficiency: Generators produce values one at a time, so they can be more memory efficient than storing all values in memory at once.
  • Lazy Evaluation: Generator expressions are evaluated lazily, meaning values are generated as they are needed, rather than all at once.
  • Efficient Pipelines: Generators can be used to create efficient data processing pipelines, where each stage of processing produces values as needed.
Labels:

Popular posts from this blog

Learn Python

  Learning Sections Introduction to Python Comment, escape sequence and print statement in Python Variables and Data Types in Python Typecasting in Python User input in Python String slicing and operations on string in Python String methods in Python If else conditional statements in Python Match case statement in Python For loops in Python While loops in Python Break and continue statement in Python Functions in Python Function Arguments in Python introduction to lists in Python List methods in Python Tuples in Python Operations on tuple in Python f strings in Python Docstrings in Python Recursion in Python Sets in Python Set methods in Python Dictionaries in Python for Loop with else in Python Exception Handling in Python Finally keyword in Python Raising custom errors in Python Short hand if else statements Enumerate Function in Python Virtual Environment in Python How import works in Python if __nam...
Read more

MultiProcessing in Python

  Learning Sections          show MultiProcessing in Python Multiprocessing in Python involves using the multiprocessing module to run multiple processes concurrently, taking advantage of multiple CPU cores. This module provides a higher level of concurrency than threading and is especially useful for CPU-bound tasks. Creating Processes You can create and start a new process by using the multiprocessing module: import multiprocessing def print_numbers (): for i in range ( 10 ): print ( i ) p1 = multiprocessing.Process ( target = print_numbers ) p1 . start () p1 . join () # Wait for the process to complete Using Process Pools The multiprocessing module provides a Pool class, which allows you to manage a pool of worker processes: from multiprocessing import Pool def square ( n ): return n * n with Pool ( 4 ) as pool : result = pool.map ( square , range (...
Read more

Match Case Statement in Python

  Learning Sections      show Match-Case Statements In Python 3.10 and later, the match-case statement was introduced as a way to perform pattern matching, similar to switch-case statements in other programming languages. It allows you to check the value of a variable against multiple patterns and execute corresponding blocks of code. Basic Match-Case Statement The match statement is followed by an expression and several case clauses. Each case specifies a pattern and an action to be taken if the pattern matches the value of the expression. # Basic match-case statement example command = "start" match command : case "start" : print ( "Starting..." ) case "stop" : print ( "Stopping..." ) case "pause" : print ( "Pausing..." ) case _: print ( "Unknown command" ) Matching Multiple Patterns Using the pipe sy...
Read more