Jesus En La Net

If we read the time.clock() documentation ( https://docs.python.org/3/library/time.html#time.clock): Deprecated since version 3.3: The behaviour of this function depends on the platform: use perf_counter() or process_time() instead, depending on your requirements, to have a well defined behaviour. I use time.perf_counter, but feel free to use time.process_time if fits for your requirements. The main difference they have are: time.perf_counter() It does include time elapsed during sleep and is system-wide. time.process_time() It does not include time elapsed during sleep. It is process-wide by definition.

As a second step learning async programming I developed a very simple spider with python 3.6 and asynchronous developing. In this case the spider request a bunch of urls. The server that is serving waits on each request. http://localhost:8000/1 The number '1' tells the number of seconds that the server should wait: http://localhost:8000/2 -> makes server wait for 2 seconds http://localhost:8000/5 -> makes server wait for 5 seconds I'm testing with a server that makes to wait my consumer, feel free to use random waits or whatever you prefer. The consumer accepts two queues, a queue for urls to retrieve, and a queue to store the results. At the moment the consumer don't store nothing at the urls queue, only retrieve the urls configured on the hardcoded urls list. More functionalities will be added in the future. In this example aiohttp==2.3.10 is used. (iospider) $ pip install "aiohttp==2.3.10" import asyncio from contextlib import

As a first approach to the async programming I'm developing small scripts with python. The main thing I need to learn is how to develop an asynchronous consumer/producer using an async Queue and python3.6. First, a reproduction of the problem with synchronous programming, later the solution I found with async programming. Synchronous # First attempt, synchronous from queue import Queue from time import sleep , perf_counter def produce (q: Queue , n: int ): for i in range (n): print ( f'produce {i}' ) q.put(i) sleep( 0.1 ) def consume (q: Queue): for i in q.queue: print ( f'consume {i}' ) sleep( 0.1 ) start = perf_counter() q = Queue() produce(q , 10 ) consume(q) print (perf_counter() - start) # Output produce 0 produce 1 produce 2 ... # imagin that consume 7 consume 8 consume 9 2.005685806274414 It takes about 2 seconds Asynchronous # Second attempt, Asynchronous import asyncio from