Heap queue or heapq in Python

A heap queue (also called a priority queue) is a data structure that allows quick access to the smallest (min-heap) or largest (max-heap) element.

• By default, heaps are implemented as min-heaps.
• Smallest element is always at the root and largest element is located among the leaf nodes of the heap.
• Python provides a built-in module called heapq that allows to create and work with heap queues

Example: Converting a normal list into a heap using heapify().

Heap queue: [15, 20, 25, 30, 40]

Explanation: heapq.heapify(li) rearranges the list into a heap where the smallest element is at the root. It does not fully sort the list.

Why do we need Heap queue?

1. Provides an efficient way to implement priority queues and maintain elements in heap order with minimal code and high performance.
2. Useful in algorithms like Dijkstra's, Huffman encoding or any task requiring quick access to smallest element.
3. Ideal for managing sorted data dynamically without full sorting after each operation.

Key Operations of a Heap

Heaps support several essential operations that help manage data efficiently while maintaining heap property.

Using Heap as a Max-Heap

By default, Python's heapq implements a min-heap. To create a max-heap simply invert the values (store negative numbers).

Example: Below example, convert a list into a max-heap by storing negative numbers and then retrieve the largest element:

Largest element: 40

Explanation: We store negative values so that the smallest (negative largest) is treated as root. When retrieving values, we multiply by -1 again to restore the original numbers.

Appending and Popping Elements

Elements can be inserted and removed while maintaining the heap property:

• heapq.heappush(heap, item) adds a new element to the heap.
• heapq.heappop(heap) removes and returns the smallest element.

Example: This code demonstrates how to create a heap, append an element and remove the smallest element.

[5, 20, 10, 30, 40, 15]
Smallest: 5
[10, 20, 15, 30, 40]

Explanation:

• heapq.heapify(h) converts the list into a valid min-heap.
• heappush(h, 5) inserts 5 into the heap and reorders it so the smallest element (5) becomes the root.
• heappop(h) removes the smallest element (5) and returns it.
• After popping, next smallest element (10) takes the root position.

Appending and Popping Simultaneously

heapq.heappushpop() pushes a new element onto the heap and removes the smallest element in a single operation.

Example: Pushes 5 onto the heap and pops the smallest element in a single step using heappushpop().

5
[10, 20, 15, 30, 40]

Explanation: heappushpop(h, 5) first pushes 5 into the heap and immediately pops the smallest element (which is also 5).

Finding Largest and Smallest Elements

heapq.nlargest() and heapq.nsmallest() return the required number of largest or smallest elements from an iterable.

Example: Finding the 3 largest and 3 smallest elements using nlargest() and nsmallest()

3 largest elements: [40, 30, 20]
3 smallest elements: [10, 15, 20]

Note: The heapq module allows in-place heap operations on lists, making it an efficient and simple way to implement priority queues and similar structures.

Replace and Merge Operations

heapq.heapreplace() removes the smallest element and inserts a new one in a single step, returning the removed value. While, heapq.merge() combines multiple sorted iterables into a single sorted sequence.

Example: This example replaces the smallest element in a heap and then merges it with another sorted list.

10
[5, 20, 15, 30, 40]
Merged heap: [2, 4, 5, 6, 8, 15, 20, 30, 40]

Explanation:

• heapreplace() replaces the smallest element (10) with 5 and smallest element is popped and 5 is inserted into the heap.
• heapq.merge() merges sorted iterables into a single sorted sequence, maintaining the heap property. Inputs must be sorted.

Difference between heapreplace() and heappushpop()

1. heapreplace() always pops smallest element and then pushes a new one whereas, heappushpop() pushes new element first, then pops smallest.
2. Use heapreplace() when you want the new element to be in the heap and heappushpop() when new element may or may not stay (depending on comparison).

Advantages vs Disadvantages