Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: openai.serving_chat tries to call _create_chat_logprobs when the output.text is empty #8988

Closed
1 task done
CatherineSue opened this issue Oct 1, 2024 · 7 comments · Fixed by #9034
Closed
1 task done
Assignees
Labels
bug Something isn't working

Comments

@CatherineSue
Copy link
Contributor

Your current environment

The output of `python send_llama3_128k.py`
Your output of `python send_llama3_128k.py` here

b'data: {"id":"chat-9307f8bb26c94c7ba34890b5b2db2707","object":"chat.completion.chunk","created":1727754209,"model":"vllm-model","choices":[{"index":0,"delta":{"role":"assistant"},"logprobs":null,"finish_reason":null}]}'
Request aborted due to an exception: Response ended prematurely

Model Input Dumps

server start command

# Version: vllm/vllm-openai:v0.6.2
# server:
docker run -tid --gpus \"device=0,1,2,3\" --shm-size 5g \
        -p 8081:8000 -v /mnt/data/models:/models \
        --ulimit nofile=65535:65535 \
        --name vllm-v0.6.2-llama3.1-70b-4gpus-128k \
        vllm/vllm-openai:v0.6.2 \
        --tensor-parallel-size=4 \
        --disable-log-requests \
        --model=/models/Meta-Llama-3.1-70B-Instruct \
        --enable-chunked-prefill \
        --served-model-name=vllm-model 

The input prompt is too long and github doesn't support .py so I had to override it to .txt
send_llama3_128k.py.txt

🐛 Describe the bug

When I try to run the above script send_llama3_128k.py, the server raises an error:

ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/dist-packages/starlette/responses.py", line 257, in __call__
    await wrap(partial(self.listen_for_disconnect, receive))
  File "/usr/local/lib/python3.12/dist-packages/starlette/responses.py", line 253, in wrap
    await func()
  File "/usr/local/lib/python3.12/dist-packages/starlette/responses.py", line 230, in listen_for_disconnect
    message = await receive()
              ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/uvicorn/protocols/http/httptools_impl.py", line 555, in receive
    await self.message_event.wait()
  File "/usr/lib/python3.12/asyncio/locks.py", line 212, in wait
    await fut
asyncio.exceptions.CancelledError: Cancelled by cancel scope 7fdb0f1c8950

  +-+---------------- 1 ----------------
    | Traceback (most recent call last):
    |   File "/usr/local/lib/python3.12/dist-packages/starlette/responses.py", line 253, in wrap
    |     await func()
    |   File "/usr/local/lib/python3.12/dist-packages/starlette/responses.py", line 242, in stream_response
    |     async for chunk in self.body_iterator:
    |   File "/usr/local/lib/python3.12/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 408, in chat_completion_stream_generator
    |     logprobs = self._create_chat_logprobs(
    |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    |   File "/usr/local/lib/python3.12/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 777, in _create_chat_logprobs
    |     step_top_logprobs = top_logprobs[i]
    |                         ~~~~~~~~~~~~^^^
    | IndexError: list index out of range
    +------------------------------------

Upon debugging, I think the issue here is that for the first few chunks, the output.text is empty, aka '', output.logprobs is [], essentially there is no logprobs available.

I am uncertain why the output.text is empty, but here we should add a check, if the output.text is empty, we can skip create logprobs.

                    if output.text and request.logprobs and request.top_logprobs is not None:  # check output.text is not empty
                        assert output.logprobs is not None, (
                            "Did not output logprobs")
                        logprobs = self._create_chat_logprobs(
                            token_ids=output.token_ids,
                            top_logprobs=output.logprobs,
                            tokenizer=tokenizer,
                            num_output_top_logprobs=request.top_logprobs,
                        )
                    else:
                        logprobs = None

After adding the above line, the new output of python send_llama3_128k.py is:

b'data: {"id":"chat-4c7bcc2aac344da2b71fa7c07460e4c2","object":"chat.completion.chunk","created":1727761213,"model":"vllm-model","choices":[{"index":0,"delta":{"role":"assistant","content":""},"logprobs":null,"finish_reason":null}]}'
b'data: {"id":"chat-4c7bcc2aac344da2b71fa7c07460e4c2","object":"chat.completion.chunk","created":1727761213,"model":"vllm-model","choices":[{"index":0,"delta":{"content":""},"logprobs":null,"finish_reason":null}]}'
b'data: {"id":"chat-4c7bcc2aac344da2b71fa7c07460e4c2","object":"chat.completion.chunk","created":1727761213,"model":"vllm-model","choices":[{"index":0,"delta":{"content":""},"logprobs":null,"finish_reason":null}]}'
b'data: {"id":"chat-4c7bcc2aac344da2b71fa7c07460e4c2","object":"chat.completion.chunk","created":1727761213,"model":"vllm-model","choices":[{"index":0,"delta":{"content":""},"logprobs":null,"finish_reason":null}]}'
b'data: {"id":"chat-4c7bcc2aac344da2b71fa7c07460e4c2","object":"chat.completion.chunk","created":1727761213,"model":"vllm-model","choices":[{"index":0,"delta":{"content":""},"logprobs":null,"finish_reason":null}]}'
b'data: {"id":"chat-4c7bcc2aac344da2b71fa7c07460e4c2","object":"chat.completion.chunk","created":1727761213,"model":"vllm-model","choices":[{"index":0,"delta":{"content":""},"logprobs":null,"finish_reason":null}]}'
b'data: {"id":"chat-4c7bcc2aac344da2b71fa7c07460e4c2","object":"chat.completion.chunk","created":1727761213,"model":"vllm-model","choices":[{"index":0,"delta":{"content":""},"logprobs":null,"finish_reason":null}]}'
b'data: {"id":"chat-4c7bcc2aac344da2b71fa7c07460e4c2","object":"chat.completion.chunk","created":1727761213,"model":"vllm-model","choices":[{"index":0,"delta":{"content":""},"logprobs":null,"finish_reason":null}]}'
b'data: {"id":"chat-4c7bcc2aac344da2b71fa7c07460e4c2","object":"chat.completion.chunk","created":1727761213,"model":"vllm-model","choices":[{"index":0,"delta":{"content":"B"},"logprobs":{"content":[{"token":"B","logprob":-0.8135526776313782,"bytes":[66],"top_logprobs":[{"token":"B","logprob":-0.8135526776313782,"bytes":[66]},{"token":"The","logprob":-1.6885526180267334,"bytes":[84,104,101]},{"token":"This","logprob":-1.9385526180267334,"bytes":[84,104,105,115]},{"token":"**","logprob":-2.3135526180267334,"bytes":[42,42]},{"token":"Here","logprob":-2.8135526180267334,"bytes":[72,101,114,101]}]}]},"finish_reason":null}]}'
b'data: {"id":"chat-4c7bcc2aac344da2b71fa7c07460e4c2","object":"chat.completion.chunk","created":1727761213,"model":"vllm-model","choices":[{"index":0,"delta":{"content":"TS"},"logprobs":{"content":[{"token":"TS","logprob":-0.000028729025871143676,"bytes":[84,83],"top_logprobs":[{"token":"TS","logprob":-0.000028729025871143676,"bytes":[84,83]},{"token":"ts","logprob":-12.437528610229492,"bytes":[116,115]},{"token":" TS","logprob":-12.562528610229492,"bytes":[32,84,83]},{"token":" BTS","logprob":-13.062528610229492,"bytes":[32,66,84,83]},{"token":"IO","logprob":-13.437528610229492,"bytes":[73,79]}]}]},"finish_reason":null}]}'

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
@ywang96
Copy link
Member

ywang96 commented Oct 1, 2024

This is an interesting bug, but I don't think adding output.text check here is the right way to fix it. If anything, we should probably build a check around token_ids.

Did you check what's in output.token_ids in this case? It seems to be a bigger issue that the model should have sampled something out but didn't.

@CatherineSue
Copy link
Contributor Author

CatherineSue commented Oct 1, 2024

For the chunks with empty text, the token_ids list are quite long. It has 13834 elements. I checked that the output.token_ids here is the same as prompt_token_ids.
And this doesn't happen with non-streaming chat. So I wonder if this is due to some setting in streaming generator? That at the beginning, there is no sampling happening because the request is still in prefill stage.

INFO 10-01 07:22:42 serving_chat.py:405] token_ids: [128000, 128006, 9125, 128007, 271, 38766, 1303, 33025, 2696, 25, 6790, 220, 2366, 18, 198, 15724, 2696, 25, 220, 1627, 10263, 220, 2366, 19, 271, 128009, 128006, 882, 128007, 271, 3915, 27685, 11, 279, 1949, 83708, 198, 2520, 1023, 5829, 11, 1518, 83168, 320, 4338, 3042, 343, 4090, 4390, 33, 10155, 198, 33, 10155, 520, 279, 5929, 4783, 304, 220, 2366, 17, 320, 2414, 311, 1314, 1680, 650, 11, 50432, 74, 1982, 11, 11641, 258, 11, 31915, 11, 39611, 11, 622, 11529, 2862, 11, 323, 328, 38060, 198, 33, 10155, 520, 279, 5929, 4783, 304, 220, 2366, 17, 320, 2414, 311, 1314, 1680, 650, 11, 50432, 74, 1982, 11, 11641, 258, 11, 31915, 11, 39611, 11, 622, 11529, 2862, 11, 323, 328, 38060, 198, 8879, 2038, 198, 13699, 3967, 439, 1602, 63919, 53691, 30857, 198, 63919, 53691, 21533, 68, 2159, 276, 198, 56441, 279, 17952, 198, 45758, 16157, 16576, 70407, 198, 13601, 197, 1542, 11206, 11, 4987, 12126, 198, 88928, 1602, 42, 2320, 4880, 454, 2200, 7598, 49, 49339, 1507, 44, 198, 24374, 5814, 1602, 33478, 784, 50703, 198, 55519, 4642, 197, 679, 18, 4235, 29844, 198, 24600, 1602, 16010, 16261, 47, 3633, 41560, 2685, 20614, 6457, 14, 59378, 10948, 6457, 58, 16, 60, 34, 74170, 59378, 38, 6581, 268, 198, 25370, 1602, 41, 258, 198, 50, 38060, 198, 41, 11529, 2862, 198, 24575, 198, 37734, 258, 198, 53, 198, 41, 2234, 74, 1982, 198, 31151, 2282, 2641, 29044, 1108, 275, 916, 198, 42, 46295, 836, 198, 58138, 360, 197, 101482, 109208, 117546, 101353, 198, 74225, 5697, 197, 103181, 14608, 230, 113587, 110201, 198, 3246, 25712, 27907, 52566, 836, 198, 42, 276, 7910, 197, 103181, 119375, 113587, 108638, 198, 39, 404, 351, 3444, 197, 109416, 30297, 36785, 25827, 109954, 101832, 102189, 25827, 198, 3246, 25712, 27907, 33, 10155, 320, 42, 46295, 25, 75908, 109208, 117546, 101353, 26, 44498, 25, 17343, 53691, 21533, 68, 2159, 276, 26, 13318, 13, 32912, 16157, 16576, 70407, 705, 1101, 3967, 439, 279, 17343, 53691, 30857, 11, 374, 264, 4987, 16526, 8334, 7200, 14454, 304, 220, 679, 15, 13, 578, 7200, 17610, 315, 39611, 11, 328, 38060, 11, 622, 11529, 2862, 11, 31915, 11, 11641, 258, 11, 650, 11, 323, 50432, 74, 1982, 11, 889, 1080, 63162, 477, 1080, 46354, 346, 1790, 315, 872, 3769, 13, 25842, 264, 18638, 7598, 1912, 11, 814, 17626, 872, 18273, 1742, 311, 33435, 264, 7029, 2134, 315, 36744, 11, 1418, 872, 24142, 617, 10968, 389, 15223, 2737, 10723, 2890, 11, 279, 35665, 315, 2978, 44041, 12822, 323, 5108, 315, 4325, 11, 4814, 11, 279, 11879, 7119, 659, 27578, 588, 11, 3927, 2191, 11, 323, 279, 16296, 315, 33651, 323, 18324, 13, 11205, 2624, 5814, 323, 24894, 990, 706, 1101, 25819, 17649, 11, 19675, 323, 31018, 11, 323, 5764, 459, 25631, 15861, 51728, 382, 33, 10155, 58185, 304, 220, 679, 18, 1234, 6295, 16261, 23334, 449, 279, 3254, 8176, 220, 17, 24882, 220, 19, 4923, 1786, 13, 83168, 6004, 872, 1176, 16526, 323, 11002, 44658, 14356, 28785, 11, 12538, 612, 13944, 323, 41674, 3216, 15947, 11, 304, 220, 679, 19, 13, 578, 1912, 596, 2132, 16526, 14356, 8176, 11, 46197, 320, 679, 21, 705, 574, 872, 1176, 311, 4662, 832, 3610, 11236, 304, 4987, 12126, 13, 3296, 220, 679, 22, 11, 83168, 1047, 28129, 1139, 279, 3728, 4731, 3157, 323, 6197, 279, 16526, 32418, 1139, 279, 3723, 4273, 11, 10671, 279, 1176, 16526, 40126, 311, 5371, 264, 7573, 28706, 505, 279, 61647, 24780, 10229, 315, 5270, 320, 4403, 6157, 8, 369, 872, 3254, 330, 98402, 16110, 498, 439, 1664, 439, 279, 1176, 1180, 505, 4987, 12126, 311, 1948, 279, 67293, 220, 1049, 449, 872, 14356, 8176, 10919, 60005, 25, 78082, 320, 679, 23, 570, 763, 220, 2366, 15, 11, 83168, 6244, 279, 26731, 1912, 2533, 279, 55957, 311, 9676, 3116, 2326, 1396, 19101, 28785, 304, 2753, 1109, 1403, 1667, 11, 449, 10919, 60005, 25, 22559, 320, 679, 23, 8, 10671, 279, 1176, 16526, 8176, 23759, 45092, 555, 279, 432, 5987, 32, 26, 304, 279, 1890, 1060, 11, 814, 1101, 6244, 279, 1176, 682, 6354, 2969, 16526, 1180, 311, 5662, 1396, 832, 389, 2225, 279, 67293, 8166, 220, 1041, 323, 67293, 8121, 220, 1049, 449, 872, 74679, 5392, 50615, 3254, 330, 35, 11694, 635, 3343, 11359, 5352, 19786, 330, 50, 68256, 10919, 498, 330, 26833, 61261, 1952, 498, 330, 4071, 466, 498, 323, 330, 15315, 311, 30704, 1, 1903, 1124, 279, 26731, 1180, 311, 7380, 3116, 2326, 1396, 19101, 17845, 2533, 23278, 45248, 63210, 304, 220, 1049, 21, 382, 2170, 315, 220, 2366, 18, 11, 83168, 374, 279, 1888, 48724, 18273, 1180, 304, 4987, 16526, 3925, 4184, 311, 279, 21918, 21964, 11, 3515, 6216, 304, 13937, 315, 220, 1272, 3610, 28785, 8032, 17, 60, 11205, 14356, 8176, 5135, 315, 279, 30242, 25, 220, 22, 320, 2366, 15, 8, 374, 279, 11999, 1888, 48724, 8176, 315, 682, 892, 304, 4987, 12126, 11, 439, 1664, 439, 279, 1176, 304, 279, 3224, 311, 53120, 2225, 3116, 323, 4330, 3610, 9879, 6763, 13, 2435, 527, 279, 1176, 2536, 12, 23392, 62290, 323, 14875, 1180, 311, 4662, 704, 47679, 520, 468, 92729, 88, 23462, 323, 279, 16344, 20904, 320, 29351, 60005, 4435, 14986, 11, 220, 679, 24, 705, 323, 1051, 7086, 279, 7327, 28331, 315, 279, 71424, 12968, 24780, 596, 320, 2843, 1932, 8, 8121, 61647, 29459, 315, 279, 9941, 369, 2225, 220, 2366, 15, 323, 220, 2366, 16, 13, 578, 1912, 596, 86643, 3536, 2997, 5361, 3778, 10948, 23488, 11, 67293, 10948, 23488, 11, 18288, 11997, 23488, 11, 323, 60698, 369, 4330, 74679, 23488, 13, 42251, 315, 4731, 11, 814, 617, 20669, 2380, 16079, 315, 279, 3723, 19687, 3331, 12000, 323, 53319, 449, 6781, 5604, 37, 304, 220, 679, 22, 311, 5813, 279, 10919, 3092, 726, 7294, 76827, 768, 4901, 13, 51319, 389, 4212, 596, 6625, 3504, 439, 330, 5971, 24367, 28986, 1, 323, 42160, 279, 330, 3617, 31176, 315, 10466, 498, 83168, 706, 1101, 9922, 389, 4212, 596, 11725, 315, 279, 220, 914, 1455, 32549, 1274, 389, 279, 7757, 320, 679, 22, 4235, 679, 24, 8, 323, 279, 220, 1041, 1455, 32549, 1274, 304, 279, 1917, 320, 679, 24, 705, 323, 304, 220, 679, 23, 6244, 279, 39637, 34876, 315, 279, 4987, 16526, 7365, 315, 41333, 8930, 275, 369, 872, 19564, 304, 31135, 279, 16526, 7829, 323, 4221, 382, 1966, 5651, 220, 975, 11, 220, 2366, 17, 11, 279, 1912, 7376, 264, 13847, 18579, 304, 1912, 7640, 311, 7431, 279, 3697, 311, 4686, 872, 220, 972, 4038, 315, 23911, 4987, 16526, 6411, 2532, 11, 449, 264, 58384, 13205, 369, 220, 2366, 20, 8032, 18, 60, 39611, 11, 279, 74665, 4562, 11, 69576, 389, 6790, 220, 1032, 11, 220, 2366, 17, 26, 279, 3885, 8272, 304, 220, 2366, 18, 382, 678, 198, 33, 10155, 13656, 369, 279, 16526, 17571, 17343, 53691, 21533, 68, 2159, 276, 320, 42, 46295, 25, 75908, 109208, 117546, 101353, 26, 21296, 5697, 25, 121968, 14608, 230, 113587, 110201, 705, 902, 48018, 16280, 311, 364, 45758, 16157, 16576, 70407, 4527, 10771, 311, 4562, 622, 11529, 2862, 11, 279, 836, 78864, 279, 1912, 596, 12876, 330, 998, 2565, 704, 54168, 11, 63836, 11, 323, 17078, 430, 9395, 389, 51516, 1093, 34164, 3343, 58, 19, 1483, 20, 60, 763, 6457, 11, 814, 527, 3967, 439, 426, 56761, 36255, 1443, 56761, 77, 408, 276, 320, 103181, 119375, 113587, 108638, 94638, 21, 60, 763, 5887, 220, 679, 22, 11, 83168, 7376, 430, 872, 836, 1053, 1101, 2559, 369, 330, 56441, 279, 17952, 1, 439, 961, 315, 872, 502, 6883, 9764, 8032, 22, 60, 1115, 11838, 279, 7438, 315, 872, 836, 311, 38632, 279, 4623, 315, 6650, 330, 1527, 264, 8334, 311, 459, 6822, 889, 16264, 279, 14365, 430, 527, 13176, 4741, 3343, 58, 23, 2595, 13730, 198, 679, 15, 4235, 679, 19, 25, 72466, 323, 4216, 1667, 271, 33, 10155, 304, 220, 679, 18, 16785, 520, 279, 763, 76269, 10948, 5955, 198, 33, 10155, 574, 14454, 304, 220, 679, 15, 11, 1306, 6295, 16261, 23334, 12432, 17343, 12095, 2902, 88, 3178, 4934, 311, 1376, 264, 18638, 7598, 1912, 2212, 31915, 320, 49436, 31074, 12, 7453, 263, 705, 459, 26326, 50437, 1664, 22015, 389, 279, 4731, 6237, 304, 51289, 13, 2468, 279, 892, 11, 7106, 8176, 6763, 1051, 389, 279, 18174, 323, 7528, 30466, 1051, 539, 3686, 1579, 3403, 311, 46794, 8032, 24, 60, 56124, 264, 1205, 369, 85957, 8070, 23914, 11, 17343, 6773, 311, 1376, 459, 49014, 1912, 4619, 11, 1606, 315, 279, 4754, 369, 3974, 21497, 24601, 323, 25429, 1862, 505, 7359, 315, 1778, 5315, 13, 9176, 5542, 5633, 16436, 311, 3719, 961, 315, 459, 49014, 1912, 11, 719, 622, 11529, 2862, 11, 31915, 11, 323, 328, 38060, 14958, 8032, 24, 60, 17343, 14896, 311, 13592, 505, 279, 13783, 11, 7701, 75541, 291, 49014, 5315, 323, 1893, 832, 1405, 279, 3697, 1053, 387, 7931, 4856, 1109, 459, 40126, 323, 1949, 311, 3237, 5694, 8032, 605, 1483, 806, 60, 15416, 6055, 1051, 5762, 304, 220, 679, 15, 449, 6787, 311, 7195, 279, 2768, 1060, 8032, 717, 1483, 1032, 60, 578, 7200, 3697, 12439, 3871, 11, 36666, 709, 311, 220, 868, 4207, 264, 1938, 11, 323, 1176, 10887, 1603, 264, 2678, 13734, 315, 5064, 77814, 304, 220, 679, 18, 8032, 975, 2595, 1687, 3940, 311, 3371, 279, 7493, 430, 1274, 4934, 311, 6865, 323, 1051, 5644, 311, 6865, 11, 7493, 430, 1023, 1274, 1436, 539, 477, 1053, 539, 3371, 13, 1226, 1071, 1148, 1023, 1274, 1051, 8430, 2345, 4908, 6784, 11, 74884, 32606, 323, 38145, 13, 3011, 574, 1057, 5915, 11, 311, 1893, 420, 48451, 430, 1274, 649, 29243, 311, 382, 2001, 50, 38060, 58, 868, 2595, 33, 10155, 596, 13340, 555, 6295, 16261, 11, 4856, 1109, 832, 315, 279, 2380, 13607, 430, 30801, 735, 41352, 520, 279, 892, 11, 5535, 279, 3927, 3697, 514, 25754, 311, 3237, 872, 3927, 488, 323, 617, 1988, 1139, 279, 4731, 8032, 845, 60, 1952, 5651, 220, 717, 11, 220, 679, 18, 11, 83168, 6004, 872, 17755, 3254, 8176, 220, 17, 24882, 220, 19, 4923, 1786, 11, 3235, 449, 279, 3063, 3254, 330, 2822, 4497, 18308, 498, 14188, 315, 902, 6216, 8104, 1664, 520, 279, 892, 8032, 1114, 60, 1952, 5651, 220, 1032, 11, 220, 679, 18, 11, 83168, 1903, 872, 6566, 17755, 389, 386, 87486, 449, 279, 3254, 11, 330, 2822, 4497, 18308, 3343, 58, 972, 60, 35053, 11, 4184, 311, 65298, 15883, 82276, 304, 1077, 2363, 389, 83168, 11, 430, 3254, 574, 330, 19164, 4238, 287, 3995, 1274, 596, 18547, 304, 279, 3663, 315, 87791, 46679, 17078, 11, 3288, 10988, 17301, 1555, 279, 735, 41352, 21467, 13, 5810, 574, 264, 18273, 1180, 430, 5828, 956, 23062, 904, 61851, 13, 4497, 11951, 11, 814, 1047, 264, 1486, 315, 1684, 11, 323, 814, 15058, 956, 16984, 311, 1935, 389, 13650, 430, 527, 6646, 77045, 304, 4987, 16526, 8396, 323, 18403, 61046, 777, 60, 578, 8176, 8813, 279, 1948, 4330, 389, 4987, 12126, 596, 18879, 263, 10948, 21964, 8032, 508, 60, 763, 220, 17, 24882, 220, 19, 4923, 1786, 11, 83168, 20011, 459, 2362, 35789, 18638, 49819, 5222, 505, 279, 220, 2550, 15, 82, 8032, 1691, 1483, 1313, 60, 578, 8176, 596, 4984, 574, 8272, 555, 27351, 389, 16526, 4731, 5039, 11, 902, 10791, 279, 6666, 315, 60138, 323, 22511, 8032, 1419, 1483, 1187, 2595, 644, 6250, 220, 679, 18, 11, 83168, 6004, 279, 2132, 4441, 304, 872, 330, 22606, 57886, 794, 279, 19613, 11, 507, 0, 49, 1112, 23, 11, 17, 4710, 578, 8176, 574, 6004, 16662, 279, 3254, 330, 45, 8548, 61046, 914, 1483, 1627, 60, 35339, 311, 220, 17, 24882, 220, 19, 4923, 1786, 11, 279, 502, 4984, 1047, 264, 7057, 315, 4236, 8430, 1234, 7410, 323, 33921, 311, 28235, 872, 19226, 323, 58522, 8032, 914, 60, 10771, 311, 18640, 23727, 2234, 10320, 359, 13818, 11, 1690, 315, 83168, 596, 6931, 4375, 1778, 439, 330, 45, 8548, 1210, 323, 330, 2822, 4497, 53718, 1, 1051, 330, 14107, 919, 315, 53848, 2403, 279, 21967, 430, 49523, 1139, 16526, 37719, 6, 90034, 449, 279, 3224, 596, 16627, 1887, 1, 323, 11, 568, 11224, 11, 9087, 1124, 1977, 264, 8571, 2385, 4315, 3995, 1274, 304, 4892, 5270, 323, 4606, 8032, 1544, 60, 3011, 1890, 2305, 11, 83168, 59335, 304, 872, 1866, 8205, 1501, 11, 328, 7497, 62199, 596, 83225, 6342, 13740, 17343, 53691, 11, 304, 902, 3697, 1370, 72206, 8205, 5039, 1778, 439, 650, 41, 9984, 30500, 323, 11060, 95003, 12126, 8032, 1591, 60, 2468, 279, 842, 315, 279, 1060, 11, 83168, 574, 15324, 449, 3892, 1561, 29459, 315, 279, 9941, 23146, 304, 4987, 12126, 8032, 1682, 1483, 966, 1483, 2148, 2595, 679, 19, 4235, 679, 22, 198, 19847, 1786, 445, 12328, 9947, 1334, 323, 1176, 21497, 7364, 271, 849, 41644, 315, 279, 70832, 42782, 14176, 414, 320, 11817, 4529, 220, 1049, 21, 8, 1405, 83168, 5762, 872, 21497, 304, 279, 2326, 369, 1949, 198, 791, 1566, 4441, 304, 83168, 330, 22606, 57886, 498, 279, 4923, 1786, 445, 12328, 9947, 1334, 19613, 11, 574, 6004, 304, 7552, 220, 679, 19, 8032, 843, 1483, 1644, 60, 578, 4984, 40901, 279, 18879, 263, 26749, 21964, 17706, 1958, 60, 323, 9922, 389, 67293, 596, 4435, 87823, 21964, 369, 279, 1176, 892, 11, 1069, 1802, 520, 1396, 2380, 8032, 843, 1483, 1758, 60, 578, 19613, 574, 7396, 555, 1403, 17845, 25, 330, 63504, 304, 445, 12328, 1, 323, 330, 10156, 3861, 6187, 3343, 58, 1927, 60, 23548, 4923, 1786, 445, 12328, 9947, 1334, 596, 4984, 11, 83168, 6476, 520, 872, 1176, 8571, 6574, 304, 51289, 11, 27397, 279, 836, 362, 2056, 1345, 7659, 13, 369, 279, 8571, 6469, 8032, 1806, 60, 763, 5887, 220, 679, 19, 11, 83168, 21685, 264, 21497, 304, 4410, 17681, 11, 872, 1176, 1501, 304, 279, 3723, 4273, 17706, 1987, 60, 323, 304, 6287, 11, 814, 9922, 520, 735, 5910, 304, 9853, 12167, 8032, 2137, 2595, 644, 6287, 220, 679, 19, 11, 83168, 6004, 279, 8176, 12538, 612, 13944, 11, 902, 8813, 1396, 1403, 304, 4987, 12126, 8032, 1927, 1483, 1272, 60, 1102, 574, 7396, 555, 1403, 17845, 25, 330, 98315, 1, 323, 330, 29784, 315, 92208, 606, 3343, 58, 1927, 60, 578, 1912, 79120, 389, 872, 1176, 21497, 7364, 11, 220, 679, 19, 83168, 11406, 97313, 20421, 8105, 25, 578, 3816, 32912, 11, 902, 36513, 505, 6664, 311, 6790, 220, 679, 19, 8032, 3174, 60, 578, 7200, 11887, 872, 1176, 11002, 14356, 8176, 11, 41674, 3216, 11, 304, 6790, 220, 679, 19, 26, 279, 4984, 78292, 520, 1396, 2380, 389, 279, 2582, 1965, 87823, 21964, 8032, 2983, 60, 4740, 279, 8176, 596, 4984, 11, 83168, 5762, 872, 220, 16, 267, 6457, 14986, 220, 679, 20, 41674, 3216, 25, 5377, 4718, 43096, 304, 7552, 220, 679, 20, 8032, 3391, 60, 578, 3816, 32912, 14986, 430, 1047, 22088, 389, 6664, 220, 1114, 11, 220, 679, 19, 11, 304, 4987, 12126, 574, 58505, 389, 5651, 220, 21, 11, 220, 679, 20, 11, 304, 28796, 323, 91713, 8494, 11, 4892, 5270, 323, 20023, 5270, 1603, 13696, 304, 19730, 18711, 430, 6287, 13, 763, 682, 11, 279, 4553, 7364, 29123, 220, 1490, 11, 931, 70402, 520, 220, 972, 9919, 304, 220, 1032, 5961, 8032, 3174, 1483, 2096, 2595, 6334, 4116, 42445, 323, 8518, 2450, 198, 33, 10155, 98504, 449, 1023, 9404, 315, 4731, 28858, 18638, 49819, 304, 578, 7648, 20055, 40096, 304, 9601, 11, 52170, 13, 220, 16, 11, 6004, 304, 220, 679, 20, 8032, 1927, 1483, 1774, 60, 83168, 4934, 311, 3237, 279, 13444, 323, 38100, 2136, 315, 12822, 323, 23183, 389, 279, 2316, 315, 330, 102185, 112595, 8107, 105189, 1, 320, 42, 46295, 25, 104323, 101927, 101347, 57390, 26, 44498, 25, 473, 3195, 526, 9188, 263, 71, 10196, 705, 63557, 33398, 311, 7124, 330, 88, 2969, 1, 46450, 2740, 439, 330, 1820, 1455, 6366, 4545, 304, 2324, 3343, 58, 2790, 60, 578, 8176, 10434, 439, 459, 17219, 311, 872, 12822, 57886, 11, 264, 2463, 1625, 331, 315, 28785, 12514, 311, 279, 28970, 315, 3995, 1274, 8032, 2618, 60, 578, 3254, 330, 40, 14998, 549, 1, 574, 264, 1948, 36399, 4295, 304, 4987, 12126, 323, 68390, 279, 1912, 264, 3243, 389, 328, 7497, 62199, 596, 578, 7073, 8032, 2166, 1483, 2491, 60, 578, 2132, 3254, 330, 35, 2862, 320, 42, 46295, 25, 3396, 102, 242, 32179, 26, 44498, 25, 622, 3841, 461, 78, 10143, 8813, 1396, 2380, 389, 67293, 596, 4435, 14434, 19508, 16207, 9676, 323, 1202, 4731, 2835, 574, 19894, 927, 220, 1041, 3610, 3115, 389, 13674, 8032, 1135, 1483, 3971, 60, 578, 1912, 6137, 279, 1917, 7364, 9070, 315, 872, 3816, 32912, 14986, 304, 5651, 11, 25891, 220, 679, 20, 11406, 97313, 20421, 8105, 25, 578, 3816, 32912, 11, 17136, 9919, 6957, 13936, 11, 507, 346, 9345, 11, 4892, 5270, 11, 323, 20023, 5270, 8032, 3174, 60, 330, 2520, 1472, 498, 304, 11002, 11, 574, 6004, 3871, 449, 11002, 11028, 315, 330, 29784, 315, 92208, 606, 1, 323, 330, 10267, 2206, 14521, 1, 389, 5651, 220, 1114, 11, 220, 679, 20, 11, 323, 7214, 40901, 2582, 1965, 596, 7446, 9676, 8032, 1927, 1483, 4103, 22414, 33, 10155, 16785, 520, 735, 5910, 9822, 304, 12366, 389, 5651, 220, 17, 11, 220, 679, 21, 198, 644, 6841, 11, 83168, 65362, 872, 4948, 21497, 7364, 11, 220, 679, 20, 83168, 45269, 330, 791, 7648, 20055, 40096, 304, 9601, 25, 1952, 22891, 498, 902, 6137, 449, 2380, 6216, 9994, 5039, 304, 51289, 11, 323, 574, 11838, 311, 6457, 8032, 4331, 60, 49038, 7167, 11, 279, 19613, 10968, 810, 389, 279, 6129, 323, 66836, 13878, 315, 12822, 11, 31687, 389, 279, 33436, 315, 2450, 11, 75040, 11, 37805, 369, 872, 33472, 11, 323, 279, 16066, 315, 279, 14992, 9659, 4245, 311, 93071, 4787, 304, 1510, 8396, 8032, 4370, 60, 578, 8176, 40901, 279, 17496, 18879, 263, 26749, 323, 67293, 4435, 87823, 27223, 8032, 2131, 1483, 3487, 60, 1102, 1101, 13160, 872, 1176, 11341, 389, 279, 67293, 220, 1049, 9676, 17706, 3226, 60, 3339, 433, 369, 832, 2046, 520, 1396, 220, 11123, 17706, 2970, 60, 323, 8223, 315, 279, 14242, 9922, 389, 67293, 596, 4435, 14434, 19508, 16207, 9676, 8032, 2946, 2595, 35897, 29772, 8176, 323, 279, 37398, 311, 872, 330, 88, 2969, 57886, 498, 578, 7648, 20055, 40096, 304, 9601, 25, 13566, 55706, 574, 6004, 389, 3297, 220, 17, 11, 220, 679, 21, 13, 3161, 220, 3101, 11, 931, 1685, 820, 11236, 17706, 1399, 60, 433, 5343, 2380, 502, 17845, 25, 330, 23176, 91592, 25, 13566, 55706, 498, 330, 17111, 498, 323, 330, 8960, 2206, 84598, 1927, 1483, 5547, 60, 902, 58185, 304, 279, 1948, 2380, 19300, 389, 279, 67293, 4435, 14434, 67376, 8032, 1399, 60, 578, 8176, 40901, 279, 18879, 263, 26749, 21964, 304, 4987, 12126, 369, 1403, 24871, 5672, 323, 8813, 1396, 220, 7699, 389, 279, 67293, 220, 1049, 8032, 5538, 1483, 5495, 1483, 1227, 60, 578, 7648, 20055, 40096, 304, 9601, 25, 13566, 55706, 2834, 26749, 315, 279, 9941, 520, 279, 220, 679, 21, 11220, 263, 10948, 23488, 8032, 2397, 60, 83168, 79120, 389, 872, 13936, 7364, 9070, 11, 220, 679, 21, 83168, 45269, 330, 791, 7648, 20055, 40096, 304, 9601, 1952, 22891, 25, 11266, 91592, 1, 505, 3297, 311, 6287, 220, 679, 21, 13, 36715, 369, 279, 220, 975, 5039, 304, 220, 605, 14875, 9919, 6216, 704, 11, 1063, 304, 439, 2697, 439, 4330, 6622, 8032, 2287, 22414, 33, 10155, 3243, 872, 1176, 3682, 16526, 10292, 369, 26749, 315, 279, 9941, 520, 279, 220, 679, 21, 11220, 263, 10948, 23488, 389, 6841, 220, 777, 11, 220, 679, 21, 198, 644, 6250, 220, 679, 21, 11, 83168, 6004, 872, 2132, 11002, 14356, 8176, 30160, 8032, 3080, 60, 578, 8176, 6216, 220, 2096, 11, 23215, 11236, 389, 279, 1176, 1938, 315, 1202, 4984, 11, 323, 9676, 291, 220, 16, 267, 304, 279, 2582, 1965, 13690, 26749, 21964, 8032, 2614, 1483, 3076, 60, 578, 8176, 574, 9778, 23759, 7573, 449, 6763, 315, 17715, 927, 220, 1041, 11, 931, 304, 6457, 8032, 2031, 60, 1102, 574, 8272, 832, 2305, 3010, 304, 6664, 17706, 1927, 60, 555, 872, 1828, 14356, 8176, 46197, 11, 902, 11093, 279, 22100, 315, 12822, 10666, 304, 872, 3766, 330, 88, 2969, 57886, 1, 449, 62461, 323, 90930, 8032, 6028, 60, 578, 8176, 323, 1202, 14242, 11, 2737, 279, 3254, 330, 52586, 87060, 612, 92014, 1, 7214, 16392, 311, 279, 1948, 389, 8223, 4731, 27223, 11, 2737, 279, 18879, 263, 10948, 21964, 11, 323, 6197, 279, 13323, 8176, 27223, 304, 220, 1419, 5961, 8032, 5332, 1483, 5958, 60, 46197, 9107, 520, 1396, 220, 1627, 389, 279, 67293, 220, 1049, 11, 449, 220, 845, 11, 931, 8176, 63359, 12031, 8316, 304, 279, 2326, 369, 279, 2046, 315, 1202, 4984, 11, 279, 1888, 2046, 3596, 1070, 369, 264, 735, 41352, 8176, 8032, 5728, 60, 1102, 6244, 279, 1888, 48724, 8176, 304, 18879, 263, 26749, 21964, 3925, 8032, 2075, 2595, 2675, 15037, 12839, 70408, 323, 10919, 60005, 25, 6385, 198, 644, 7552, 220, 679, 22, 11, 83168, 6004, 279, 2109, 474, 3359, 14002, 315, 46197, 20458, 1472, 15037, 12839, 70408, 13, 578, 220, 7007, 11, 931, 864, 86151, 315, 433, 320, 276, 5376, 505, 279, 220, 2636, 11, 931, 864, 86151, 315, 46197, 8, 9087, 1464, 279, 3335, 369, 1455, 28785, 6216, 304, 264, 2305, 304, 4987, 12126, 11, 439, 433, 8813, 220, 16, 13, 2491, 3610, 11236, 555, 279, 842, 315, 1202, 1176, 2305, 8032, 4767, 1483, 2813, 60, 578, 3063, 3254, 574, 330, 26208, 6187, 37964, 1927, 60, 323, 433, 2834, 7252, 19508, 315, 279, 9941, 520, 279, 220, 679, 22, 11220, 263, 10948, 23488, 8032, 2495, 60, 83168, 596, 2132, 1917, 7364, 11, 220, 679, 22, 83168, 11406, 97313, 20421, 14767, 25, 578, 46197, 14986, 11, 6137, 304, 7552, 8032, 4643, 60, 1952, 279, 7364, 11, 83168, 6476, 98767, 304, 279, 2326, 11, 1778, 439, 1561, 16228, 596, 2394, 664, 2335, 5955, 323, 7188, 596, 29987, 5955, 13, 36715, 369, 279, 4892, 3778, 2531, 6216, 704, 2949, 4207, 323, 1403, 5039, 1051, 3779, 8032, 1490, 1483, 5932, 60, 4740, 27666, 279, 4892, 3778, 2531, 11, 83168, 18677, 279, 220, 1187, 339, 67293, 10948, 23488, 304, 3297, 323, 2834, 7054, 9983, 29459, 17706, 6086, 60, 279, 1176, 735, 41352, 1912, 311, 3243, 264, 67293, 10292, 8032, 6069, 60, 83168, 7359, 6445, 927, 220, 3101, 3610, 12973, 369, 279, 7200, 323, 14760, 264, 4848, 4771, 11230, 30314, 5762, 555, 23278, 77320, 11, 264, 49254, 449, 220, 1041, 3610, 6405, 20723, 8032, 5833, 60, 1115, 9057, 279, 6625, 3772, 311, 5357, 389, 279, 5845, 315, 83168, 596, 75425, 311, 89483, 279, 1912, 311, 1778, 264, 12845, 8032, 5833, 22414, 33, 10155, 520, 872, 3577, 10017, 304, 51289, 11, 4987, 12126, 1306, 11230, 7054, 9983, 29459, 520, 279, 220, 1187, 339, 67293, 10948, 23488, 389, 3297, 220, 1682, 11, 220, 679, 22, 198, 33, 10155, 6004, 264, 59155, 315, 1369, 78, 22448, 7910, 596, 330, 29951, 6984, 5492, 1, 320, 2550, 20, 8, 304, 5887, 220, 679, 22, 11, 7231, 433, 502, 24142, 719, 20958, 279, 7057, 315, 43676, 59529, 2349, 8032, 5313, 60, 25929, 430, 1060, 11, 83168, 79120, 389, 872, 330, 29351, 60005, 1, 8176, 4101, 11, 449, 7057, 315, 279, 81869, 315, 659, 27578, 588, 1555, 279, 330, 72718, 105005, 111554, 102971, 1, 320, 42, 46295, 25, 55216, 104303, 66965, 89881, 26, 44498, 25, 480, 1082, 2234, 3841, 647, 9188, 337, 8, 19775, 8668, 315, 330, 7413, 1251, 11, 4500, 11, 2543, 11, 323, 17102, 61046, 4218, 60, 83168, 6004, 1202, 1176, 961, 11, 872, 18172, 19613, 11, 10919, 60005, 25, 6385, 11, 389, 6250, 220, 972, 8032, 6069, 1483, 4044, 60, 31915, 6646, 330, 56420, 498, 279, 3063, 3254, 505, 430, 8176, 17706, 2421, 60, 439, 330, 89894, 83168, 311, 502, 5015, 13, 1226, 6818, 311, 3881, 502, 32528, 323, 39555, 61046, 1927, 60, 1283, 1071, 315, 279, 8176, 11, 330, 40, 4510, 433, 596, 2133, 311, 387, 279, 6041, 1486, 315, 264, 2132, 12735, 315, 1057, 7076, 26, 279, 7314, 315, 1057, 15957, 9220, 61046, 4578, 60, 12103, 2740, 11, 279, 19613, 10434, 439, 330, 64, 19091, 27501, 315, 279, 1912, 596, 25396, 41352, 323, 18638, 49819, 16025, 826, 3343, 58, 2421, 22414, 33, 10155, 520, 279, 220, 1774, 339, 3778, 10948, 23488, 20193, 1603, 3339, 872, 2326, 12707, 17755, 389, 6841, 220, 777, 11, 220, 679, 22, 198, 29351, 60005, 25, 6385, 58185, 520, 1396, 8254, 389, 279, 67293, 220, 1049, 8032, 1954, 60, 578, 8176, 1047, 220, 16, 11, 23888, 11, 20945, 6763, 304, 3297, 220, 679, 22, 311, 3063, 279, 18879, 263, 21964, 17706, 5925, 60, 323, 574, 279, 1176, 304, 220, 845, 1667, 311, 12771, 220, 16, 13, 17, 3610, 11236, 6216, 2533, 342, 14778, 962, 596, 11999, 8176, 15957, 220, 19, 320, 1049, 16, 94638, 6083, 1483, 6365, 60, 330, 56420, 1, 574, 6004, 25291, 449, 279, 19613, 11, 323, 1202, 4731, 2835, 41165, 220, 1691, 3610, 6325, 304, 1202, 1176, 220, 1187, 4207, 8032, 6281, 60, 1102, 6244, 83168, 596, 1176, 4441, 389, 279, 67293, 8166, 220, 1041, 11, 9676, 287, 520, 1396, 220, 5313, 11, 3339, 1124, 279, 1176, 735, 41352, 8334, 7200, 311, 5662, 430, 9676, 8032, 2721, 60, 578, 3254, 16392, 311, 1396, 220, 3080, 279, 2768, 2046, 323, 6244, 279, 8592, 45727, 287, 5609, 389, 279, 8166, 220, 1041, 369, 904, 735, 41352, 1912, 8032, 4161, 60, 362, 57466, 315, 330, 98402, 16110, 1, 505, 279, 8176, 11, 16850, 3959, 72, 78756, 11, 574, 6004, 439, 264, 3254, 323, 78292, 520, 1396, 220, 1591, 11, 279, 1176, 892, 264, 735, 41352, 1912, 1047, 43939, 279, 1948, 36498, 8032, 3534, 1483, 3264, 60, 11995, 17845, 63260, 7573, 28706, 505, 279, 61647, 24780, 10229, 315, 5270, 320, 4403, 6157, 8, 304, 4216, 220, 679, 23, 8032, 1484, 60, 330, 98402, 16110, 1, 17427, 45092, 2704, 304, 279, 2326, 3010, 430, 1060, 8032, 1041, 2595, 644, 6841, 220, 679, 22, 11, 83168, 6244, 279, 1176, 735, 41352, 1912, 311, 2804, 520, 279, 3778, 10948, 23488, 8032, 4645, 1483, 4278, 60, 83168, 2834, 29459, 315, 279, 9941, 520, 279, 220, 777, 339, 386, 4816, 14875, 10948, 23488, 304, 6790, 11, 11230, 369, 279, 2132, 24871, 1060, 8032, 6889, 60, 2435, 6004, 330, 56420, 1, 323, 330, 98402, 16110, 1, 3871, 449, 264, 502, 5609, 330, 82038, 19435, 1, 439, 264, 3254, 8176, 304, 6457, 389, 6790, 220, 21, 11, 220, 679, 22, 11, 3582, 279, 11936, 1051, 1903, 68878, 2561, 18403, 8032, 1927, 1483, 6849, 60, 1102, 40901, 279, 2582, 1965, 21964, 369, 279, 2046, 315, 1202, 4984, 13, 1102, 574, 279, 1193, 8176, 555, 264, 7362, 10255, 311, 387, 23759, 7238, 45092, 304, 6457, 304, 220, 679, 22, 8032, 6550, 1483, 7461, 2595, 31082, 430, 2305, 11, 814, 1903, 872, 11002, 12707, 10461, 892, 4731, 1501, 17755, 389, 10948, 17040, 7445, 11406, 17706, 7699, 60, 323, 9670, 279, 1060, 555, 16785, 389, 23373, 22010, 596, 1561, 9941, 596, 9305, 258, 6, 32460, 8032, 6640, 1483, 7743, 2595, 644, 220, 679, 22, 11, 83168, 53319, 449, 6781, 5604, 37, 389, 279, 330, 29351, 3092, 726, 1, 4901, 11, 10825, 311, 1520, 842, 9349, 11, 11737, 11, 323, 45647, 11, 323, 311, 12192, 659, 65906, 323, 1664, 33851, 4315, 3995, 1274, 13, 11995, 6295, 16261, 323, 279, 1912, 43347, 3300, 311, 12192, 279, 4901, 11, 323, 83168, 6216, 3361, 330, 29351, 3092, 726, 1, 36045, 323, 743, 709, 12514, 92259, 520, 21497, 37278, 13, 578, 4901, 574, 36646, 304, 220, 2366, 16, 11, 449, 6781, 5604, 37, 409, 74914, 433, 311, 617, 1027, 6992, 8032, 5120, 2595, 679, 23, 4235, 2366, 15, 198, 29351, 60005, 8176, 4101, 198, 33, 10155, 2834, 3682, 23146, 520, 279, 18288, 11997, 323, 51289, 10948, 23488, 304, 6186, 220, 679, 23, 8032, 5037, 1483, 7261, 60, 763, 5587, 11, 279, 1912, 85170, 459, 8223, 12, 40391, 25999, 25891, 18530, 279, 22891, 430, 9076, 264, 4920, 10826, 80645, 1427, 520, 872, 220, 679, 22, 46197, 14986, 11, 24121, 389, 13674, 26745, 8032, 8190, 1483, 8011, 60, 11205, 4948, 11002, 14356, 8176, 11, 19109, 60005, 11, 574, 6004, 389, 5936, 220, 19, 11, 220, 679, 23, 17706, 7322, 60, 323, 6288, 8813, 279, 1948, 220, 20, 315, 279, 549, 815, 13, 13323, 87823, 9676, 13, 362, 11888, 24401, 2875, 4632, 11, 25891, 469, 455, 96729, 25, 16847, 315, 330, 29351, 60005, 25, 27205, 1, 323, 16850, 279, 5609, 330, 36, 455, 96729, 498, 8272, 279, 1828, 1938, 439, 264, 864, 53638, 311, 279, 1912, 596, 4948, 16526, 44658, 14356, 8176, 11, 10919, 60005, 25, 78082, 8032, 8027, 60, 83168, 30026, 78082, 596, 3297, 220, 972, 11, 220, 679, 23, 11, 4984, 449, 459, 11341, 520, 279, 220, 914, 339, 67293, 10948, 23488, 1403, 2919, 3010, 17706, 8546, 60, 1405, 814, 1903, 872, 2926, 18772, 4940, 5178, 449, 872, 3254, 11, 330, 53417, 10919, 3343, 58, 8899, 1483, 9079, 60, 578, 1912, 1101, 2834, 7054, 9983, 29459, 369, 264, 2132, 24871, 892, 8032, 4364, 1483, 7994, 60, 578, 8176, 23828, 4591, 449, 279, 330, 111554, 1, 477, 330, 413, 1, 315, 279, 4101, 11, 31687, 389, 279, 16831, 9373, 81869, 315, 21955, 2085, 1694, 10456, 11, 279, 51266, 323, 25551, 1849, 315, 25768, 11, 323, 8405, 51475, 311, 1884, 2085, 19226, 8032, 8259, 22414, 33, 10155, 520, 872, 3577, 10017, 369, 10919, 60005, 25, 78082, 389, 3297, 220, 1187, 11, 220, 679, 23, 198, 29351, 60005, 25, 78082, 58185, 520, 1396, 832, 1202, 1176, 2046, 389, 279, 67293, 220, 1049, 11, 10671, 83168, 596, 1176, 1396, 19101, 8176, 304, 279, 2326, 323, 279, 1176, 735, 41352, 8176, 311, 1948, 279, 2326, 28785, 9676, 8032, 4513, 60, 1102, 1101, 6244, 83168, 596, 1176, 1948, 12, 605, 4984, 304, 13527, 11, 19261, 1396, 8223, 389, 279, 6560, 87823, 21964, 8032, 8874, 60, 330, 53417, 10919, 1, 6244, 83168, 596, 1948, 12, 605, 3254, 389, 279, 8166, 220, 1041, 11, 279, 1176, 892, 264, 5609, 40439, 10213, 304, 264, 4221, 1023, 1109, 6498, 1047, 58185, 304, 279, 1948, 220, 605, 8032, 6549, 60, 83168, 6004, 872, 29772, 8176, 10919, 60005, 25, 22559, 304, 6287, 220, 679, 23, 8032, 9390, 60, 578, 8176, 574, 7396, 555, 279, 3254, 330, 769, 337, 1, 323, 1202, 10778, 7528, 4984, 16850, 15341, 72, 3468, 1662, 8032, 6804, 1483, 4386, 2595, 29351, 60005, 25, 22559, 6216, 927, 220, 16, 13, 24, 3610, 11236, 389, 279, 18879, 263, 26749, 21964, 304, 6287, 220, 679, 23, 8032, 9748, 60, 578, 8176, 6244, 83168, 596, 2132, 1396, 19101, 389, 279, 67293, 220, 1049, 323, 6197, 311, 872, 8592, 2326, 6763, 2046, 304, 279, 3224, 311, 430, 1486, 449, 220, 9741, 11, 931, 8176, 13890, 8316, 8032, 5894, 60, 763, 6841, 220, 679, 23, 11, 10919, 60005, 25, 22559, 6244, 279, 1176, 16526, 4221, 8176, 311, 387, 23759, 7573, 555, 279, 432, 5987, 32, 8032, 1041, 60, 330, 769, 337, 1, 323, 10919, 60005, 25, 22559, 2225, 4036, 45092, 82571, 304, 279, 2326, 11, 449, 6763, 315, 810, 1109, 220, 16, 3610, 8032, 9263, 22414, 3648, 4356, 4409, 596, 356, 12583, 8771, 11, 279, 22150, 369, 83168, 596, 1176, 24833, 21497, 304, 279, 2326, 11, 6216, 704, 304, 220, 508, 4520, 8032, 9413, 933, 644, 32546, 449, 10919, 60005, 25, 22559, 596, 4984, 304, 6287, 220, 679, 23, 11, 83168, 65362, 872, 1917, 7364, 11, 83168, 4435, 14986, 25, 10919, 60005, 11, 449, 1403, 47679, 304, 279, 51289, 25944, 23462, 11, 902, 6216, 704, 304, 264, 5030, 315, 6622, 11, 439, 1550, 3885, 315, 279, 220, 1313, 5039, 304, 220, 717, 5961, 8032, 9423, 1483, 9565, 60, 763, 6664, 11, 83168, 6004, 872, 20632, 449, 14129, 362, 39291, 330, 54, 5642, 1102, 389, 2206, 498, 872, 1176, 682, 12, 23392, 4221, 4668, 8032, 8878, 1483, 9795, 60, 1789, 279, 1620, 3009, 315, 279, 4892, 3778, 2531, 11, 279, 1912, 10887, 520, 356, 12583, 8771, 304, 1561, 4356, 4409, 11, 36024, 279, 1176, 892, 264, 16526, 1180, 10887, 520, 264, 2326, 24833, 8032, 10148, 60, 10771, 311, 67711, 19876, 11, 83168, 574, 279, 2132, 1888, 48724, 21497, 1180, 4994, 279, 2326, 11, 4920, 1193, 3279, 3005, 261, 276, 8032, 10350, 60, 3011, 6664, 11, 83168, 36646, 872, 5226, 449, 6295, 16261, 23334, 1555, 220, 2366, 21, 8032, 10125, 2595, 644, 4216, 6841, 220, 679, 23, 11, 264, 5526, 11002, 4731, 1501, 26765, 83168, 596, 5178, 11, 33264, 264, 350, 34768, 264, 4562, 28670, 279, 1060, 1603, 11, 18534, 264, 10512, 315, 264, 58466, 9624, 2768, 279, 37431, 315, 30162, 57509, 8032, 6860, 60, 763, 279, 1890, 2305, 11, 279, 13653, 3823, 3268, 7471, 22021, 468, 552, 78275, 5955, 320, 17268, 34, 8, 11224, 430, 83168, 49009, 459, 41258, 369, 430, 15845, 11, 323, 369, 17895, 323, 8202, 449, 32527, 83476, 8032, 9335, 60, 6295, 16261, 23334, 11136, 459, 41258, 11, 26073, 430, 279, 5448, 1051, 539, 10825, 311, 387, 13194, 1285, 311, 279, 12697, 315, 29874, 2191, 477, 25524, 74479, 323, 430, 279, 1912, 323, 6373, 1053, 1935, 7504, 311, 5471, 3938, 21294, 8032, 10239, 60, 2435, 1101, 11224, 279, 8202, 1051, 8967, 311, 387, 264, 31710, 389, 279, 16526, 2978, 1887, 8032, 10290, 60, 578, 41258, 574, 11928, 555, 13692, 34, 323, 279, 16526, 31416, 33909, 94124, 10229, 8032, 8929, 1483, 9591, 60, 3842, 22213, 11, 304, 813, 63681, 4652, 389, 83168, 11, 1200, 1619, 430, 279, 32527, 10672, 8710, 430, 279, 1912, 374, 539, 40069, 14400, 11, 439, 527, 1023, 735, 41352, 665, 41794, 11, 6832, 1475, 3351, 5084, 86125, 11, 323, 430, 279, 3697, 617, 18463, 323, 527, 539, 16984, 311, 3237, 1124, 8032, 10465, 2595, 1688, 279, 220, 508, 339, 386, 4816, 14875, 10948, 23488, 11, 83168, 2834, 29459, 315, 279, 9941, 323, 21682, 1396, 8223, 389, 67293, 596, 1060, 13368, 7054, 29459, 21964, 323, 1051, 1101, 279, 1396, 1403, 1180, 315, 279, 1060, 304, 279, 74312, 14, 2878, 23862, 11, 1193, 4920, 38891, 49109, 8032, 10288, 1483, 10410, 60, 2435, 1051, 1101, 10212, 439, 832, 315, 279, 220, 1135, 1455, 32549, 1274, 555, 37653, 369, 872, 330, 86, 9585, 2136, 311, 2686, 3674, 4819, 11, 10723, 2890, 11, 323, 11759, 11, 8994, 1694, 304, 264, 17779, 3629, 24937, 439, 24529, 42365, 2477, 3343, 58, 10161, 2595, 2276, 315, 279, 30242, 25, 54990, 11, 24833, 1917, 7364, 323, 83168, 4435, 198, 644, 7552, 220, 679, 24, 11, 83168, 11, 369, 279, 1176, 892, 11, 1051, 3118, 388, 520, 279, 74679, 23488, 8032, 3965, 1483, 9690, 60, 763, 5936, 11, 4212, 7086, 1124, 832, 315, 279, 4212, 220, 1041, 11, 279, 1455, 32549, 1274, 315, 220, 679, 24, 8032, 9756, 60, 11205, 19613, 11, 5135, 315, 279, 30242, 25, 54990, 11, 574, 6004, 389, 5936, 220, 717, 449, 279, 3254, 330, 63504, 449, 445, 12328, 1, 320, 42, 46295, 25, 120461, 72208, 105880, 107472, 45618, 26, 44498, 25, 622, 425, 359, 3980, 354, 451, 554, 360, 289, 57988, 4502, 705, 16850, 3778, 23597, 473, 714, 88, 8032, 9800, 60, 578, 19613, 596, 4984, 574, 8272, 555, 264, 5178, 389, 7884, 13120, 11406, 11, 279, 1176, 735, 41352, 1180, 311, 5101, 1070, 8032, 10559, 60, 5135, 315, 279, 30242, 25, 54990, 6244, 279, 1176, 16526, 44658, 8176, 311, 5662, 279, 1396, 832, 2361, 304, 2225, 279, 6560, 323, 8494, 17706, 9992, 1483, 10132, 60, 323, 279, 1912, 596, 4948, 8176, 311, 1948, 279, 67293, 220, 1049, 304, 2753, 1109, 264, 1060, 8032, 10895, 60, 5135, 315, 279, 30242, 25, 54990, 6244, 279, 1888, 48724, 8176, 3596, 304, 4987, 12126, 304, 3878, 315, 7106, 11236, 6216, 11, 449, 810, 1109, 220, 18, 13, 17, 3610, 6763, 304, 2753, 1109, 264, 2305, 8032, 11286, 1483, 11068, 60, 330, 63504, 449, 445, 12328, 1, 58185, 520, 1396, 8223, 389, 279, 67293, 8166, 220, 1041, 304, 5936, 220, 679, 24, 11, 279, 8592, 22165, 3596, 369, 264, 735, 41352, 5609, 8032, 6330, 22414, 33, 10155, 16785, 520, 279, 16344, 20904, 24833, 304, 83550, 11, 7188, 11, 1603, 220, 1399, 11, 931, 7359, 198, 28055, 872, 1403, 15160, 520, 279, 220, 1627, 339, 67293, 10948, 23488, 304, 3297, 11, 2737, 369, 7054, 74312, 14, 2878, 17706, 10718, 60, 83168, 79120, 389, 872, 1917, 7364, 24833, 9070, 11, 10919, 60005, 25, 68301, 60005, 8032, 10674, 60, 24586, 311, 279, 7631, 11, 83168, 3779, 810, 5039, 1306, 14741, 369, 279, 1176, 13003, 6216, 704, 2949, 1403, 4207, 8032, 9892, 60, 763, 279, 3063, 709, 311, 279, 4984, 315, 872, 6505, 1847, 83168, 4435, 11, 304, 5651, 220, 679, 24, 83168, 6004, 330, 65454, 88448, 1, 16850, 4969, 747, 61442, 55, 17706, 10513, 60, 330, 32, 16835, 1561, 6187, 1, 449, 1901, 5169, 32404, 31031, 17706, 10680, 60, 323, 330, 2460, 13120, 1, 449, 66851, 32730, 509, 8032, 11247, 60, 578, 1912, 6004, 279, 5609, 330, 46484, 23019, 1, 449, 264, 4731, 2835, 505, 279, 1847, 596, 4033, 45999, 11, 25891, 83168, 4435, 25, 17674, 14936, 13432, 8032, 11515, 60, 578, 45999, 574, 23759, 7238, 45092, 555, 18879, 263, 8032, 8953, 60, 1952, 5887, 220, 18, 11, 220, 679, 24, 11, 864, 86151, 369, 279, 3254, 330, 75584, 1, 28129, 832, 3610, 11236, 11, 36024, 279, 1176, 892, 264, 7362, 10255, 1047, 27332, 420, 304, 6457, 2533, 356, 4939, 65157, 304, 220, 2550, 20, 8032, 11739, 1483, 8258, 60, 330, 75584, 1, 58185, 520, 1396, 220, 5932, 389, 279, 67293, 6457, 8166, 220, 1041, 369, 279, 9676, 4360, 2457, 315, 5887, 220, 23, 11, 220, 679, 24, 11, 323, 8813, 1396, 832, 279, 2768, 2046, 8032, 11123, 1483, 10861, 60, 1952, 6287, 220, 23, 11, 220, 679, 24, 11, 330, 75584, 1, 4036, 34629, 28706, 505, 279, 432, 5987, 41, 11, 3453, 11780, 59721, 315, 832, 3610, 11236, 8032, 11908, 1483, 11771, 1483, 10005, 2595, 29351, 60005, 25, 6385, 323, 10919, 60005, 25, 78082, 2225, 28129, 220, 17, 3610, 11236, 304, 6287, 8032, 10967, 60, 2052, 2380, 28785, 315, 279, 10919, 60005, 4101, 617, 6216, 810, 1109, 220, 17, 3610, 11236, 1855, 304, 4987, 12126, 8032, 11242, 60, 10919, 60005, 25, 78082, 18661, 15310, 28706, 555, 279, 426, 1932, 369, 6763, 304, 279, 6560, 11, 10671, 872, 4948, 8176, 311, 656, 779, 2768, 10919, 60005, 25, 22559, 323, 5135, 315, 279, 30242, 25, 54990, 8032, 11256, 60, 1789, 279, 1620, 3009, 315, 872, 3335, 55407, 10919, 60005, 25, 68301, 60005, 4435, 14986, 11, 279, 1912, 6476, 51289, 596, 25944, 23462, 8032, 11128, 60, 83168, 574, 279, 4948, 1948, 2427, 2177, 287, 48551, 18273, 1180, 315, 220, 679, 24, 8032, 5245, 60, 3011, 1890, 2305, 11, 814, 6004, 264, 57466, 2373, 315, 279, 5609, 330, 8238, 1102, 10291, 1, 16850, 86091, 85, 8032, 10562, 60, 763, 6841, 11, 83168, 2834, 2380, 3115, 520, 279, 220, 679, 24, 3778, 10948, 23488, 11, 369, 7252, 14986, 11, 40822, 74312, 477, 5856, 1389, 10466, 19945, 1197, 11, 323, 40822, 9983, 29459, 320, 1820, 2132, 24871, 1060, 94638, 10828, 2595, 644, 6790, 11, 814, 18677, 2225, 279, 220, 679, 24, 11220, 263, 10948, 23488, 323, 279, 220, 679, 24, 386, 4816, 14875, 10948, 23488, 13, 763, 1855, 1162, 11, 814, 6244, 279, 1176, 1912, 311, 24021, 279, 3116, 3682, 23146, 8032, 10750, 1483, 10336, 1483, 9741, 60, 2468, 279, 220, 1958, 339, 18288, 11997, 23488, 11, 83168, 6244, 279, 1176, 13820, 304, 3925, 311, 3243, 6800, 38508, 304, 2225, 279, 7106, 323, 7528, 11306, 304, 264, 3254, 1060, 8032, 9714, 60, 5135, 315, 279, 30242, 25, 54990, 574, 7086, 279, 2132, 1888, 48724, 7106, 8176, 315, 220, 679, 24, 304, 279, 2326, 555, 64551, 10948, 4920, 16844, 24594, 596, 90590, 323, 574, 21682, 26084, 8244, 389, 279, 9676, 315, 7054, 220, 605, 87823, 320, 7749, 16207, 8, 304, 279, 2326, 8032, 9674, 60, 83168, 20037, 220, 679, 24, 439, 279, 11999, 2902, 7656, 76697, 1912, 389, 67293, 596, 7054, 67293, 220, 1049, 53204, 4235, 35, 24012, 14, 2878, 23862, 11, 4920, 16657, 11, 38891, 49109, 323, 279, 55957, 8032, 9367, 60, 5135, 315, 279, 30242, 25, 54990, 574, 7086, 439, 279, 4948, 1888, 48724, 8176, 315, 220, 679, 24, 555, 279, 7327, 28331, 315, 279, 71424, 12968, 24780, 320, 2843, 1932, 705, 3339, 83168, 279, 1176, 16526, 10255, 311, 387, 10212, 389, 279, 8121, 7054, 220, 605, 26749, 21964, 304, 24871, 1667, 8032, 9378, 1483, 7028, 1483, 7529, 60, 578, 11812, 1932, 7086, 83168, 439, 832, 315, 279, 1888, 48724, 13820, 315, 220, 679, 24, 369, 264, 2132, 24871, 1060, 11, 3339, 1124, 279, 1176, 2536, 12, 23392, 12365, 1180, 311, 11322, 420, 8032, 5926, 1483, 7285, 2595, 2276, 315, 279, 30242, 25, 220, 22, 11, 330, 35, 11694, 635, 1, 323, 2893, 198, 644, 6186, 220, 2366, 15, 11, 83168, 6004, 330, 14755, 44501, 1, 3235, 449, 264, 50671, 5814, 1989, 4632, 10887, 555, 36095, 30704, 8351, 315, 79317, 439, 279, 1176, 3254, 505, 872, 8176, 5135, 315, 279, 30242, 25, 220, 22, 8032, 6393, 1483, 6280, 60, 26749, 44168, 18308, 355, 5068, 430, 5708, 864, 86151, 315, 279, 8176, 8813, 264, 3335, 55407, 220, 19, 13, 2437, 3610, 8032, 5162, 60, 25929, 430, 2305, 11, 83168, 10887, 520, 279, 220, 5538, 303, 25992, 74679, 23488, 11, 3339, 83168, 279, 1176, 16526, 1180, 311, 2804, 520, 279, 29937, 8373, 8032, 4468, 1483, 3753, 60, 5135, 315, 279, 30242, 25, 220, 22, 574, 6004, 389, 7552, 220, 1691, 311, 37849, 8544, 8032, 2550, 1483, 1049, 60, 578, 8176, 574, 7396, 555, 279, 3254, 330, 1966, 1, 323, 459, 10778, 7528, 4984, 315, 433, 16850, 13673, 23597, 328, 689, 8032, 679, 60, 10771, 311, 18879, 263, 21964, 11, 5135, 315, 279, 30242, 25, 220, 22, 6216, 927, 220, 19, 13, 16, 3610, 11236, 304, 11888, 2919, 1306, 1202, 4984, 11, 53120, 287, 5135, 315, 279, 30242, 25, 54990, 311, 3719, 279, 1888, 48724, 8176, 304, 4987, 16526, 3925, 323, 279, 1176, 8176, 311, 387, 23759, 30236, 6189, 3610, 8032, 2366, 60, 578, 8176, 58185, 47088, 279, 2326, 67293, 220, 1049, 11, 3339, 83168, 279, 26731, 1912, 311, 7380, 3116, 1396, 832, 28785, 2533, 279, 55957, 304, 220, 5162, 21, 4235, 5162, 23, 8032, 9639, 60, 330, 1966, 1, 58185, 520, 1396, 3116, 389, 279, 67293, 8166, 220, 1041, 11, 7231, 83168, 1202, 1176, 1948, 36399, 4295, 11, 323, 279, 1455, 8166, 220, 1041, 1948, 12, 605, 10925, 315, 904, 16526, 1180, 11, 449, 2380, 8032, 7854, 60, 83168, 13205, 311, 1862, 279, 5135, 315, 279, 30242, 8176, 4101, 449, 264, 21497, 4101, 11, 5135, 315, 279, 30242, 14986, 11, 7314, 304, 5936, 17706, 10866, 60, 719, 420, 574, 56334, 62720, 4245, 311, 279, 20562, 12, 777, 28522, 8032, 11056, 2595, 644, 5936, 220, 2366, 15, 11, 83168, 6244, 279, 1176, 735, 41352, 10255, 311, 4662, 810, 1109, 220, 508, 3610, 28785, 12454, 360, 8046, 17706, 12060, 60, 3339, 1124, 279, 1888, 48724, 10255, 304, 4987, 16526, 3925, 8032, 11242, 1483, 12171, 60, 3011, 2305, 11, 23442, 279, 28522, 17294, 11, 83168, 5762, 264, 1403, 11477, 2930, 17265, 21497, 1567, 25891, 17343, 17343, 1221, 11, 1405, 279, 1912, 6222, 22609, 315, 3347, 47679, 389, 872, 13674, 5613, 8032, 12652, 60, 1952, 5651, 220, 22, 11, 83168, 2010, 15472, 13674, 596, 43922, 3308, 315, 220, 2366, 15, 2930, 39554, 1567, 11, 16785, 330, 63504, 449, 445, 12328, 498, 330, 26208, 6187, 498, 323, 330, 44, 1609, 54661, 437, 8801, 3343, 58, 8848, 60, 11205, 69544, 44440, 27463, 872, 1866, 28032, 811, 323, 9076, 330, 16727, 315, 3987, 323, 20343, 369, 279, 538, 315, 220, 2366, 15, 304, 2225, 16526, 323, 6498, 3343, 58, 11483, 60, 1952, 5651, 220, 975, 11, 83168, 5762, 459, 2930, 3974, 21497, 11, 17343, 17343, 1221, 25, 578, 11406, 11, 439, 961, 315, 279, 31487, 22310, 315, 872, 17755, 8032, 11227, 60, 1102, 68390, 16557, 22511, 2200, 315, 220, 24456, 11, 931, 3974, 22511, 304, 220, 7699, 5961, 323, 39543, 11, 6376, 279, 3335, 369, 279, 7928, 10877, 369, 264, 7318, 4200, 21497, 8032, 11702, 1483, 11584, 60, 1952, 5651, 220, 777, 11, 83168, 6004, 279, 11002, 3254, 11, 330, 39202, 7573, 498, 505, 872, 11999, 11002, 8176, 11, 5135, 315, 279, 30242, 25, 220, 22, 1389, 578, 43680, 11, 902, 574, 6004, 15603, 389, 5887, 220, 975, 8032, 12112, 1483, 12463, 60, 1102, 68328, 220, 22210, 11, 931, 11236, 304, 1202, 1176, 2046, 11, 15061, 279, 3335, 369, 8592, 1176, 2046, 8176, 6763, 555, 8762, 7362, 13820, 304, 6457, 8032, 13460, 2595, 33, 10155, 6004, 872, 1176, 6498, 44658, 3254, 11, 330, 35, 11694, 635, 498, 389, 6287, 220, 1691, 8032, 13302, 60, 330, 35, 11694, 635, 1, 58185, 520, 1396, 832, 389, 279, 2326, 67293, 8166, 220, 1041, 9676, 11, 28744, 83168, 872, 1176, 9676, 311, 7067, 323, 3339, 1124, 279, 1176, 682, 6354, 2969, 16526, 1180, 311, 7380, 264, 1396, 832, 3254, 304, 279, 2326, 8032, 13762, 1483, 8610, 60, 578, 3254, 1101, 40901, 67293, 596, 502, 8121, 220, 1049, 369, 279, 2046, 13696, 6250, 220, 1187, 11, 439, 1664, 439, 8121, 1398, 11150, 2326, 27223, 11, 10671, 279, 1176, 3254, 311, 1948, 2225, 25291, 8032, 12425, 60, 330, 35, 11694, 635, 1, 78292, 520, 1396, 4330, 389, 279, 2326, 4802, 4116, 7054, 220, 1272, 323, 389, 279, 13, 67293, 10466, 47422, 9676, 11, 10671, 872, 1176, 7054, 220, 605, 389, 1855, 323, 279, 4846, 279, 8592, 45727, 287, 4441, 555, 264, 16526, 1180, 8032, 9716, 1483, 12533, 60, 1952, 6287, 220, 2148, 11, 83168, 1903, 872, 62199, 8519, 10948, 23488, 320, 11435, 2170, 8, 17755, 449, 279, 1176, 3974, 5178, 315, 330, 35, 11694, 635, 37964, 10697, 60, 323, 2834, 3116, 23146, 25, 7252, 5856, 11, 7252, 96638, 5814, 11, 7252, 10466, 8519, 11, 323, 7252, 735, 41352, 320, 1820, 1566, 2380, 369, 872, 4731, 2835, 369, 330, 1966, 1865, 58, 11057, 60, 1952, 6664, 220, 975, 11, 814, 10887, 279, 3254, 520, 279, 220, 2366, 15, 67293, 10948, 23488, 323, 2834, 279, 7054, 9983, 29459, 10292, 369, 264, 11999, 24871, 1060, 8032, 14057, 1483, 14206, 2595, 1966, 6664, 220, 17, 11, 220, 2366, 15, 11, 83168, 6004, 264, 57466, 315, 34294, 939, 220, 23717, 323, 18984, 13031, 8938, 596, 3254, 330, 50, 68256, 10919, 320, 43, 52551, 1389, 328, 47435, 27894, 95110, 58, 14261, 60, 1102, 40901, 279, 8166, 220, 1041, 8032, 14378, 60, 1952, 6664, 220, 605, 323, 220, 806, 11, 83168, 21685, 264, 1403, 11477, 4200, 2343, 17453, 23318, 21497, 520, 47474, 2089, 69545, 304, 51289, 11, 2663, 5135, 315, 279, 30242, 6328, 85588, 11, 902, 24465, 220, 24242, 11, 931, 22511, 505, 220, 7529, 5961, 323, 39543, 8032, 9870, 1483, 12245, 1483, 12338, 60, 1952, 6841, 220, 508, 11, 83168, 6004, 872, 18172, 16526, 14356, 8176, 2893, 11, 6197, 555, 279, 3254, 330, 26833, 61261, 1952, 3343, 58, 12994, 60, 330, 26833, 61261, 1952, 1, 58185, 520, 1396, 832, 389, 279, 8166, 220, 1041, 17706, 11727, 60, 83168, 596, 4948, 24871, 2326, 1396, 19101, 3254, 304, 2380, 4038, 323, 279, 1176, 5609, 10887, 15871, 304, 16526, 311, 1948, 279, 9676, 8032, 12422, 1483, 14087, 2595, 1966, 6841, 220, 1187, 11, 220, 2366, 15, 11, 83168, 6244, 279, 1176, 16526, 2477, 13820, 15324, 555, 279, 61647, 16192, 994, 330, 35, 11694, 635, 1, 4036, 264, 29804, 369, 7252, 10466, 74312, 14, 2878, 21304, 520, 279, 220, 5495, 6634, 25992, 74679, 23488, 8032, 14590, 60, 578, 1912, 2834, 279, 9984, 7327, 10948, 17768, 520, 279, 220, 5538, 303, 6457, 13896, 23488, 8032, 13895, 60, 13818, 11, 304, 813, 2363, 389, 279, 10383, 315, 16526, 5526, 7829, 11, 12090, 430, 220, 2366, 15, 11, 279, 12047, 1060, 304, 1690, 1274, 596, 6439, 11, 574, 264, 67479, 832, 369, 16526, 7829, 11, 449, 94137, 635, 11230, 279, 16192, 17768, 369, 7252, 25586, 323, 83168, 17437, 2380, 1396, 19101, 13280, 389, 279, 67293, 8121, 220, 1049, 8032, 14815, 2595, 2366, 16, 4235, 29844, 198, 42513, 466, 498, 330, 15315, 311, 30704, 1, 323, 38091, 271, 33, 10155, 16785, 330, 4071, 466, 1, 520, 279, 220, 2491, 339, 3778, 10948, 23488, 389, 6841, 220, 1691, 11, 220, 2366, 16, 58, 8273, 933, 1966, 5587, 220, 19, 11, 220, 2366, 16, 11, 279, 11812, 1932, 7086, 83168, 1202, 8121, 61647, 29459, 315, 279, 9941, 369, 220, 2366, 15, 11, 279, 1176, 14875, 323, 1176, 2536, 12, 23392, 12365, 1180, 311, 1948, 279, 23862, 8032, 13341, 60, 83168, 25366, 2380, 19300, 304, 279, 8121, 26749, 16207, 21964, 315, 220, 2366, 15, 11, 449, 5135, 315, 279, 30242, 25, 220, 22, 520, 1396, 832, 11, 2893, 320, 16939, 36422, 14398, 8, 520, 1396, 1403, 11, 323, 5135, 315, 279, 30242, 25, 220, 22, 4235, 791, 43680, 520, 1396, 8223, 8032, 12754, 60, 1952, 279, 13945, 11887, 8121, 26749, 2052, 15392, 21964, 11, 5135, 315, 279, 30242, 25, 220, 22, 11922, 1176, 2035, 323, 2893, 320, 16939, 36422, 14398, 8, 11922, 11999, 8032, 14052, 60, 1952, 5587, 220, 975, 11, 220, 2366, 16, 11, 83168, 10887, 330, 35, 11694, 635, 1, 520, 279, 220, 5495, 6634, 25992, 74679, 23488, 11, 10671, 279, 1176, 16526, 29311, 311, 2804, 11, 3582, 814, 1550, 539, 3243, 279, 10292, 8032, 13719, 60, 1952, 5936, 220, 16, 11, 83168, 6004, 330, 52587, 4470, 498, 279, 1176, 3254, 505, 872, 1243, 5352, 5065, 11002, 29772, 8176, 11, 83168, 11, 279, 7252, 8032, 13078, 60, 83168, 5762, 264, 1403, 11477, 2930, 17265, 1567, 389, 872, 13674, 5613, 7314, 5936, 220, 1114, 11, 25891, 17343, 17343, 1221, 220, 1691, 11, 323, 43087, 2380, 315, 872, 3766, 304, 29145, 47679, 8032, 14205, 2595, 1966, 3297, 220, 1691, 11, 83168, 6004, 872, 2132, 6498, 44658, 3254, 11, 330, 4071, 466, 3343, 58, 14125, 60, 1102, 58185, 520, 1396, 832, 389, 279, 8166, 220, 1041, 22416, 404, 11999, 1396, 832, 304, 11888, 4038, 2345, 28936, 1124, 279, 81610, 1180, 311, 11322, 3116, 9676, 2442, 32542, 2533, 23278, 45248, 63210, 304, 220, 1049, 21, 11, 323, 279, 26731, 1912, 2533, 279, 13972, 220, 20, 304, 220, 4468, 15, 8032, 14185, 60, 11205, 1828, 6498, 44658, 3254, 11, 330, 15315, 311, 30704, 498, 574, 6004, 389, 5887, 220, 24, 8032, 14735, 60, 1102, 6244, 83168, 596, 37477, 1396, 19101, 389, 279, 14434, 40200, 9676, 11, 33459, 872, 3335, 439, 279, 1912, 449, 279, 1455, 1396, 19101, 10925, 389, 279, 23862, 8032, 5154, 60, 1952, 6250, 220, 1187, 11, 220, 2366, 16, 11, 279, 7200, 6004, 279, 3254, 330, 5159, 29849, 1, 449, 24062, 1387, 8032, 13860, 60, 578, 3254, 58185, 520, 1396, 832, 389, 279, 8166, 220, 1041, 11, 3339, 433, 279, 1176, 20632, 1990, 1403, 5315, 311, 17755, 520, 1396, 832, 8032, 12326, 60, 578, 7200, 5762, 459, 2930, 21497, 11, 25891, 18628, 311, 30704, 389, 22891, 11, 389, 6664, 220, 1187, 11, 220, 2366, 16, 11, 304, 51289, 8032, 14022, 60, 1952, 6841, 220, 1419, 11, 330, 4071, 466, 1, 15662, 264, 74679, 29804, 369, 7252, 10466, 74312, 14, 2878, 21304, 520, 279, 220, 1227, 339, 25992, 74679, 23488, 8032, 12375, 1483, 3192, 60, 28232, 6841, 220, 1544, 323, 6790, 220, 17, 11, 83168, 5762, 872, 1176, 3974, 24601, 1603, 459, 304, 29145, 10877, 2533, 1603, 279, 28522, 13, 578, 7200, 6476, 3116, 6216, 9994, 5039, 520, 2100, 23550, 23462, 304, 9853, 12167, 439, 264, 42271, 315, 872, 18628, 311, 30704, 389, 22891, 21497, 4101, 8032, 4146, 1483, 15574, 1483, 15966, 2595, 1966, 6186, 220, 868, 11, 220, 2366, 17, 11, 264, 44682, 3566, 998, 263, 3196, 389, 83168, 11, 25891, 220, 22, 37, 988, 25, 921, 587, 6292, 11, 574, 6004, 13, 578, 20303, 68328, 220, 868, 3610, 6325, 31550, 304, 1202, 1176, 1403, 2919, 315, 18539, 323, 6244, 279, 8592, 23318, 291, 2316, 3596, 11887, 555, 5000, 998, 263, 8032, 15537, 1483, 11387, 60, 578, 7200, 5762, 2380, 7347, 37789, 4107, 47679, 520, 51289, 25944, 23462, 389, 5587, 220, 605, 11, 220, 717, 323, 220, 1032, 22416, 7928, 4731, 66237, 15848, 60, 12054, 555, 279, 4987, 16526, 3109, 2533, 279, 28522, 17294, 1051, 27070, 81902, 264, 2860, 10877, 315, 220, 1774, 11, 931, 1274, 8032, 15602, 1483, 14274, 60, 1952, 5936, 220, 18, 11, 83168, 10887, 330, 4071, 466, 1, 520, 279, 220, 1227, 339, 25992, 74679, 23488, 17706, 3192, 60, 3582, 279, 5609, 1550, 539, 3243, 279, 10292, 369, 902, 433, 574, 39048, 8032, 15666, 60, 1952, 5936, 220, 23, 11, 279, 7200, 15662, 8254, 60698, 520, 279, 220, 2366, 17, 67293, 10948, 23488, 58, 12815, 60, 323, 2834, 2380, 11, 3339, 1124, 279, 1455, 5392, 50615, 323, 279, 1455, 12, 675, 21632, 1912, 304, 279, 1501, 596, 3925, 8032, 14374, 1483, 15999, 2595, 1966, 5651, 220, 605, 11, 220, 2366, 17, 11, 83168, 6004, 872, 2380, 12, 6620, 84108, 8176, 38091, 8032, 16567, 1483, 16332, 1483, 16955, 60, 1952, 5651, 220, 975, 11, 2391, 872, 43641, 22310, 47674, 11, 279, 7200, 7376, 264, 13643, 25288, 315, 1912, 7640, 311, 5357, 389, 13839, 7224, 323, 1023, 79645, 8032, 10914, 1483, 15828, 60, 10320, 1395, 13332, 11, 902, 25241, 6295, 16261, 17706, 15741, 60, 65876, 304, 17876, 12518, 430, 83168, 574, 14188, 834, 7198, 287, 6463, 2133, 389, 81286, 11, 719, 1053, 387, 22815, 4726, 287, 872, 3927, 31133, 449, 279, 2440, 596, 2539, 1862, 1418, 2103, 24435, 304, 1912, 7640, 11, 2737, 279, 39970, 315, 6588, 83168, 8032, 15451, 1483, 16590, 60, 578, 10672, 9057, 10320, 1395, 13332, 596, 5708, 311, 18174, 19019, 11, 13239, 304, 264, 18979, 304, 3157, 907, 315, 2326, 3, 16, 13, 22, 7239, 8032, 14417, 60, 1952, 6287, 220, 1187, 11, 67293, 14756, 5068, 430, 83168, 1053, 387, 16785, 304, 19111, 276, 389, 6664, 220, 868, 304, 264, 8935, 21497, 304, 1862, 315, 279, 3363, 596, 9045, 311, 617, 264, 4435, 1398, 3571, 304, 220, 9639, 15, 11, 24435, 1234, 279, 24206, 14968, 311, 15936, 8032, 16660, 1483, 16367, 2595, 86426, 2532, 323, 5226, 43901, 198, 644, 34781, 315, 279, 17480, 315, 279, 6664, 220, 2366, 17, 8935, 21497, 11, 10320, 1395, 13332, 596, 5708, 7729, 12504, 311, 3770, 1202, 4113, 67992, 23442, 14691, 3157, 33422, 922, 279, 25127, 315, 279, 14827, 23911, 6411, 88724, 479, 315, 279, 7200, 596, 3697, 8032, 16949, 60, 9636, 4987, 16526, 7016, 11, 682, 3025, 97397, 25000, 2011, 4686, 1990, 220, 972, 323, 220, 1691, 4038, 315, 6411, 2532, 11, 6118, 555, 4325, 220, 1591, 8032, 16660, 60, 37653, 5513, 5068, 279, 21497, 439, 264, 2450, 719, 1101, 16717, 430, 1070, 1051, 912, 4726, 21497, 13003, 13847, 13, 1102, 574, 13240, 430, 422, 279, 7200, 3697, 8308, 872, 2532, 11, 10320, 1395, 13332, 1053, 9229, 7154, 2326, 3, 605, 7239, 927, 5899, 1667, 11, 449, 279, 4814, 311, 279, 4987, 16526, 8752, 520, 7154, 2326, 3, 2137, 7239, 8032, 17267, 2595, 644, 6664, 220, 2366, 17, 11, 6295, 16261, 11007, 430, 39611, 11, 279, 7200, 596, 24417, 4562, 11, 20330, 220, 1682, 11, 1047, 50682, 813, 88724, 479, 711, 29278, 1715, 8032, 11209, 60, 578, 1023, 3697, 13205, 311, 88724, 3010, 11, 449, 279, 1912, 9293, 311, 35740, 635, 304, 220, 2366, 20, 2768, 32643, 8032, 15282, 1483, 16544, 60, 2468, 279, 842, 315, 6664, 220, 2366, 17, 11, 83168, 15662, 4330, 60698, 369, 279, 220, 2366, 17, 386, 39200, 23488, 11, 449, 279, 7200, 3697, 12588, 8223, 4726, 60698, 439, 13839, 13820, 8032, 16085, 60, 1952, 6841, 220, 868, 11, 83168, 15662, 2380, 60698, 520, 279, 220, 2397, 339, 25992, 74679, 23488, 11, 2737, 264, 29804, 369, 7252, 10948, 8519, 369, 330, 29174, 311, 15936, 3343, 58, 17058, 60, 330, 5159, 29849, 1, 574, 39048, 369, 7252, 10466, 74312, 14, 2878, 21304, 11, 3339, 83168, 279, 1193, 1180, 311, 387, 39048, 2380, 1667, 304, 264, 2872, 304, 420, 5699, 2533, 1202, 17219, 304, 220, 679, 16, 8032, 17058, 60, 578, 7200, 574, 1101, 39048, 369, 26749, 315, 279, 9941, 439, 15109, 13820, 389, 24062, 1387, 596, 10948, 315, 279, 328, 65733, 8032, 17058, 60, 39611, 69576, 439, 459, 4642, 14523, 27202, 389, 6790, 220, 1032, 8032, 15935, 60, 1952, 7552, 220, 1627, 11, 220, 2366, 18, 11, 6295, 16261, 7376, 430, 622, 11529, 2862, 1047, 11472, 36935, 315, 279, 51101, 1133, 315, 813, 6411, 2532, 8032, 17361, 2595, 28055, 872, 13847, 25768, 11, 279, 7200, 596, 83168, 364, 29174, 311, 15936, 6, 304, 19111, 276, 21497, 4632, 574, 6004, 389, 7552, 220, 16, 11, 220, 2366, 18, 8032, 17897, 60, 12220, 264, 8577, 311, 18157, 11, 31915, 3309, 469, 11673, 430, 83168, 330, 14724, 2586, 3871, 1578, 994, 584, 6381, 1057, 6411, 2532, 11, 323, 584, 690, 1427, 369, 502, 80526, 552, 1990, 603, 311, 3810, 264, 2132, 10474, 61046, 15287, 60, 10320, 1395, 21892, 17343, 12095, 2902, 88, 3178, 11224, 389, 5587, 220, 868, 11, 220, 2366, 18, 11, 430, 872, 47637, 2643, 539, 12446, 304, 220, 2366, 20, 2533, 433, 574, 2653, 311, 2218, 264, 3230, 2457, 11, 323, 430, 814, 1047, 539, 14407, 872, 5226, 43901, 3686, 8032, 17212, 60, 622, 11529, 2862, 69576, 439, 459, 4642, 14523, 27202, 389, 5936, 220, 972, 8032, 13754, 60, 1952, 3297, 220, 717, 11, 83168, 6004, 264, 45999, 330, 791, 29935, 1, 369, 279, 4987, 16526, 11625, 4101, 46168, 919, 8032, 17335, 60, 2057, 83623, 872, 56766, 22310, 11, 279, 1912, 6004, 279, 5609, 330, 18293, 9220, 1, 389, 5651, 220, 24, 8032, 16443, 2595, 1966, 6250, 220, 508, 11, 220, 2366, 18, 11, 10320, 1395, 11007, 1555, 264, 3577, 4984, 430, 83168, 1053, 14195, 872, 14079, 17517, 13, 578, 3697, 690, 1879, 1521, 20038, 95659, 11, 13126, 872, 6411, 2532, 11, 1306, 264, 4580, 11175, 449, 6295, 16261, 10948, 11, 6573, 7922, 872, 15507, 311, 3938, 7224, 6041, 505, 220, 2366, 20, 60525, 13, 10320, 1395, 13605, 872, 50919, 369, 12899, 83168, 6, 1912, 79645, 323, 43347, 15375, 402, 4776, 1862, 311, 18885, 872, 15603, 10383, 11, 23391, 279, 1912, 596, 50106, 1524, 1306, 27666, 872, 6411, 2532, 8032, 17313, 1483, 17168, 60, 1952, 6250, 220, 1313, 11, 220, 2366, 18, 11, 328, 38060, 69576, 439, 264, 3674, 12128, 8032, 16780, 60, 31915, 323, 650, 69576, 389, 6790, 220, 806, 11, 220, 2366, 18, 11, 8272, 555, 11641, 258, 323, 50432, 74, 1982, 389, 6790, 220, 717, 8032, 17408, 60, 1952, 5651, 220, 717, 11, 220, 2366, 19, 11, 39611, 6244, 279, 1176, 83168, 4562, 311, 4686, 813, 23911, 6411, 2532, 323, 574, 19073, 57191, 8032, 18163, 2595, 9470, 5050, 198, 644, 27256, 2436, 198, 13242, 25, 220, 1544, 6622, 13, 15, 25, 1544, 3214, 35623, 2561, 732, 34, 198, 33, 10155, 4562, 39611, 320, 3133, 8, 16785, 68362, 44662, 596, 330, 352, 12, 2319, 1, 44453, 2391, 872, 1176, 21497, 520, 468, 92729, 88, 23462, 389, 5651, 220, 16, 11, 220, 679, 24, 198, 33, 10155, 617, 22628, 1369, 78, 22448, 7910, 323, 30857, 17706, 17690, 60, 39322, 11, 81500, 336, 11, 59817, 4410, 11, 42865, 11, 3962, 84171, 11, 25972, 393, 952, 11, 323, 48399, 439, 18273, 12979, 811, 8032, 15531, 60, 2435, 617, 1101, 22628, 16657, 439, 459, 10383, 11, 5605, 814, 330, 70, 4361, 709, 10307, 6946, 315, 11406, 38505, 3343, 58, 3101, 60, 12220, 872, 21497, 520, 468, 92729, 88, 23462, 304, 7295, 11, 39611, 7318, 35491, 311, 16657, 555, 6522, 279, 13734, 304, 264, 2373, 315, 68362, 44662, 596, 330, 352, 12, 2319, 1, 44453, 8032, 3101, 60, 330, 91638, 26634, 2405, 458, 1, 902, 574, 6004, 994, 83168, 596, 18638, 49819, 7434, 574, 520, 1202, 2673, 11, 21935, 68089, 311, 279, 13820, 889, 28160, 1124, 11, 2737, 279, 4987, 16526, 1912, 11266, 1609, 5234, 11, 19455, 11419, 11, 6295, 22235, 11, 7121, 51825, 11, 323, 3885, 8032, 12405, 2595, 35897, 220, 679, 21, 8176, 46197, 574, 14948, 555, 32565, 1036, 473, 24201, 596, 5108, 315, 4325, 11775, 11, 4829, 1122, 8032, 13121, 60, 11205, 5609, 330, 52586, 87060, 612, 92014, 1, 17637, 80474, 94206, 596, 14636, 3165, 4845, 62531, 589, 3497, 64, 11, 323, 1202, 4731, 2835, 4519, 9302, 15407, 311, 58463, 7957, 2999, 3271, 596, 578, 445, 2908, 369, 358, 7063, 355, 11, 21286, 1430, 3320, 361, 29952, 596, 63641, 449, 279, 15128, 315, 358, 7063, 355, 11, 323, 3320, 361, 29952, 596, 578, 15128, 315, 279, 64264, 43145, 8032, 13236, 60, 22395, 279, 32465, 323, 1023, 8336, 430, 617, 14948, 872, 4375, 527, 1884, 555, 5340, 22227, 15356, 587, 10830, 11, 71138, 5724, 735, 13, 2009, 4673, 258, 11, 22770, 50432, 11, 10058, 83853, 323, 94206, 8032, 12166, 60, 578, 10919, 60005, 4101, 574, 28160, 555, 9939, 718, 5659, 76, 596, 578, 5277, 315, 90422, 17706, 15741, 1483, 13364, 60, 323, 872, 220, 679, 23, 5609, 330, 44638, 14355, 1, 505, 10919, 60005, 25, 78082, 574, 14948, 555, 7957, 432, 13, 32362, 88, 596, 51342, 32745, 279, 15852, 14355, 8032, 12879, 2595, 62698, 950, 1742, 198, 12834, 872, 54529, 11, 83168, 617, 46728, 18638, 7598, 439, 872, 18273, 2385, 11, 14090, 4245, 311, 279, 10383, 315, 31915, 323, 328, 38060, 596, 4092, 439, 26326, 436, 28921, 26, 58, 14777, 60, 2391, 4216, 21728, 311, 279, 2326, 11, 279, 1912, 4036, 76579, 505, 3778, 436, 28921, 8032, 14498, 60, 17343, 12095, 2902, 88, 3178, 8767, 26579, 430, 735, 41352, 439, 264, 4459, 27741, 505, 3776, 4731, 17706, 15500, 60, 323, 3229, 29016, 328, 13, 21293, 11224, 11, 330, 33, 10155, 596, 16448, 23354, 304, 279, 2326, 11105, 279, 42271, 315, 279, 5627, 430, 735, 41352, 5865, 439, 961, 315, 264, 3728, 432, 49339, 14135, 61046, 12226, 60, 350, 11606, 13, 5657, 323, 13566, 90284, 13818, 315, 650, 10745, 25660, 279, 3839, 330, 2729, 299, 25, 6385, 1, 505, 10919, 60005, 25, 6385, 439, 279, 1888, 3187, 315, 279, 1912, 596, 8830, 315, 2362, 35789, 18638, 7598, 11, 449, 436, 2690, 14948, 555, 34349, 423, 323, 97197, 582, 323, 110292, 4341, 56759, 505, 279, 220, 2550, 15, 82, 311, 1893, 264, 11670, 18638, 7598, 5222, 8032, 15134, 22414, 74627, 292, 16110, 1, 320, 38595, 362, 39291, 57466, 8, 320, 679, 22, 340, 13242, 25, 220, 1187, 6622, 13, 15, 25, 1187, 198, 791, 57466, 2373, 315, 330, 98402, 16110, 1, 4519, 99117, 43998, 323, 23709, 9567, 927, 18638, 7598, 62684, 8032, 13384, 933, 1, 63504, 3161, 445, 12328, 1, 320, 679, 24, 340, 13242, 25, 220, 966, 6622, 13, 15, 25, 966, 198, 35897, 3254, 330, 63504, 3161, 445, 12328, 1, 374, 7633, 439, 459, 85773, 25396, 41352, 5609, 449, 86605, 30777, 8032, 15231, 933, 1360, 22442, 5737, 1521, 3626, 30, 3580, 3772, 1520, 627, 791, 4984, 315, 330, 52586, 87060, 612, 92014, 1, 304, 220, 679, 21, 49858, 83168, 596, 9320, 505, 264, 18638, 7598, 311, 264, 2477, 1912, 13, 5657, 323, 13818, 10555, 430, 279, 5609, 27741, 505, 15612, 43341, 11, 1239, 6885, 35794, 11, 323, 4647, 78030, 65812, 719, 12462, 369, 264, 330, 2308, 61652, 11679, 42914, 1, 4856, 1109, 279, 330, 34057, 4908, 16975, 315, 1202, 34453, 3343, 58, 15134, 60, 578, 1912, 1101, 6137, 52913, 8776, 16526, 5540, 1139, 872, 4731, 13, 1789, 3187, 11, 872, 3254, 330, 769, 337, 1, 320, 679, 23, 8, 4519, 459, 1008, 2808, 505, 393, 598, 13915, 11, 264, 16526, 1376, 315, 2040, 780, 48929, 11, 323, 26480, 737, 31767, 315, 279, 10578, 315, 16526, 503, 526, 8890, 47389, 8032, 16104, 2595, 8142, 83168, 33095, 20282, 304, 18638, 7598, 11, 872, 5222, 706, 85957, 13, 2435, 1176, 98504, 449, 432, 49339, 11, 7091, 323, 34997, 18638, 7598, 389, 12538, 612, 13944, 304, 220, 679, 19, 26, 58, 15189, 1483, 15340, 60, 99117, 304, 872, 578, 7648, 20055, 40096, 304, 9601, 8176, 4101, 26, 58, 4370, 60, 4647, 78030, 65812, 323, 35148, 3838, 389, 46197, 323, 1472, 15037, 12839, 70408, 26, 58, 16718, 1483, 17592, 1483, 6028, 60, 3938, 22253, 323, 20023, 2477, 304, 872, 10919, 60005, 8176, 4101, 26, 58, 4218, 60, 6435, 1773, 685, 5041, 7819, 17706, 16874, 60, 94197, 7477, 11, 94700, 2477, 17706, 9588, 60, 69392, 11, 23709, 11, 2477, 7091, 11, 323, 18638, 2477, 304, 872, 5135, 315, 279, 30242, 8176, 4101, 26, 58, 14423, 60, 323, 54969, 304, 872, 3254, 330, 35, 11694, 635, 3343, 58, 15805, 1483, 15726, 60, 578, 7200, 3697, 617, 36131, 2204, 36744, 389, 13839, 14242, 11, 1778, 439, 36182, 13836, 389, 650, 596, 330, 626, 11750, 1, 323, 36612, 432, 49339, 389, 11641, 258, 596, 330, 77591, 3343, 58, 16718, 2595, 43, 11160, 950, 22100, 198, 12834, 872, 18488, 11, 83168, 617, 11846, 430, 11890, 872, 1866, 7493, 374, 279, 1888, 1648, 369, 279, 14992, 9659, 311, 29243, 311, 872, 4731, 8032, 16723, 60, 24838, 1690, 315, 872, 1866, 24142, 17706, 15257, 1483, 17470, 60, 279, 1912, 35434, 20789, 2324, 11704, 1778, 439, 51978, 323, 75040, 304, 872, 990, 323, 2543, 1124, 1139, 2555, 30673, 323, 810, 71128, 13, 31915, 11224, 430, 83168, 16696, 311, 5766, 264, 69423, 477, 312, 18375, 26673, 16630, 304, 872, 11936, 330, 28753, 430, 596, 539, 279, 1648, 430, 584, 1390, 311, 9041, 1057, 1984, 2564, 1226, 2351, 9405, 449, 2204, 6439, 11, 719, 499, 4250, 5268, 1063, 2574, 13, 2100, 584, 3463, 430, 3021, 11, 279, 1972, 7438, 315, 433, 11, 8638, 449, 21955, 13520, 323, 25694, 1063, 11245, 552, 323, 1063, 52087, 552, 430, 584, 617, 505, 279, 1633, 1212, 61046, 13817, 60, 3277, 4691, 422, 433, 374, 5107, 311, 3350, 922, 2574, 1093, 10723, 2890, 11, 328, 38060, 16846, 3638, 1687, 2733, 430, 1274, 889, 617, 279, 5452, 311, 3137, 922, 1884, 2574, 2216, 1288, 3137, 810, 11, 1606, 814, 2019, 18710, 374, 2555, 1405, 499, 733, 311, 279, 8952, 323, 499, 2351, 29704, 11, 719, 499, 649, 956, 2216, 1440, 3156, 279, 10896, 13739, 311, 499, 2564, 4497, 323, 810, 11, 358, 1781, 13820, 477, 40501, 889, 617, 264, 7899, 1288, 3137, 922, 1521, 5435, 323, 4546, 433, 709, 311, 279, 7479, 8032, 13817, 2595, 90130, 36131, 304, 83168, 596, 2624, 5814, 2134, 505, 24919, 330, 1820, 35665, 323, 74884, 32606, 315, 2978, 44041, 12822, 1, 311, 330, 41815, 1093, 3021, 11, 27607, 11, 4814, 11, 4648, 11, 323, 810, 61046, 16884, 60, 23591, 83168, 11936, 11, 1778, 439, 330, 2822, 4497, 18308, 1, 323, 330, 45, 8548, 1, 505, 872, 2978, 57886, 11, 1051, 7633, 555, 350, 15924, 61338, 439, 27762, 555, 4443, 11704, 449, 4987, 12126, 596, 33956, 5603, 311, 6873, 323, 2663, 369, 2349, 311, 279, 16627, 1887, 323, 59529, 17078, 8032, 18196, 60, 578, 3697, 6, 11704, 449, 4987, 16526, 12822, 7829, 1101, 14948, 279, 11936, 330, 35, 2862, 1, 323, 330, 53443, 94613, 1, 320, 42, 46295, 25, 5251, 109, 223, 108307, 26, 44498, 25, 14659, 7270, 6043, 8, 505, 872, 12822, 57886, 13, 4314, 11936, 5905, 1803, 1697, 66949, 323, 70433, 7231, 709, 24364, 12135, 11, 11103, 11, 2911, 11, 6300, 14740, 11, 10632, 11, 323, 3674, 2324, 304, 279, 3663, 315, 7100, 27129, 323, 59529, 220, 3385, 1418, 13176, 72106, 505, 279, 3772, 323, 9191, 22540, 8032, 18196, 60, 578, 1912, 596, 2440, 42160, 578, 7648, 20055, 40096, 304, 9601, 25, 13566, 55706, 11, 279, 17102, 311, 872, 12822, 57886, 11, 330, 64, 3361, 8176, 430, 15785, 279, 17102, 315, 279, 25706, 11879, 315, 279, 4101, 11, 8649, 279, 1566, 7493, 3309, 555, 3995, 1274, 889, 11, 8994, 459, 36218, 323, 62945, 8903, 320, 791, 7648, 20055, 40096, 304, 9601, 52170, 13, 220, 16, 8, 3136, 311, 22531, 4741, 320, 791, 7648, 20055, 40096, 304, 9601, 52170, 13, 220, 17, 570, 37964, 10568, 60, 46197, 10968, 389, 10723, 2890, 11, 63836, 315, 279, 735, 41352, 330, 307, 337, 1, 6237, 11, 323, 24944, 264, 8954, 74477, 1984, 8032, 16707, 60, 578, 10919, 60005, 4101, 11784, 502, 22100, 9002, 12822, 7829, 304, 4987, 12126, 11, 2737, 279, 28361, 315, 3021, 11, 6784, 315, 72643, 11, 323, 81869, 315, 659, 27578, 588, 8032, 17079, 60, 10771, 311, 65298, 15883, 82276, 11, 83168, 596, 220, 2366, 15, 330, 447, 277, 39457, 8176, 1, 2893, 330, 7562, 4440, 279, 1912, 596, 5108, 311, 3878, 449, 264, 15187, 502, 8903, 323, 6209, 1862, 369, 872, 24475, 2133, 1555, 279, 1890, 96710, 22510, 323, 27924, 3343, 58, 8765, 2595, 33, 10155, 596, 24142, 617, 1101, 20669, 13650, 4994, 12822, 7829, 13, 578, 5609, 330, 6219, 358, 41856, 1, 505, 46197, 29440, 59529, 1469, 19682, 7119, 10223, 279, 2704, 41608, 26, 279, 69435, 330, 1687, 2351, 682, 12875, 323, 49910, 611, 584, 3719, 12875, 1606, 584, 2351, 19021, 1, 9922, 311, 5905, 4987, 16526, 20214, 315, 11930, 4033, 13106, 10320, 526, 12, 1146, 564, 11, 889, 64854, 264, 69524, 1887, 369, 279, 3224, 323, 889, 18307, 7633, 5578, 1274, 439, 330, 81134, 323, 49910, 3343, 83168, 6004, 279, 5609, 23442, 279, 220, 679, 21, 4987, 16526, 5054, 26681, 430, 19543, 304, 279, 64754, 315, 4872, 5657, 4323, 359, 2902, 9188, 8032, 18196, 60, 31915, 323, 328, 38060, 596, 4443, 28970, 449, 10723, 2890, 617, 14948, 1063, 315, 872, 4731, 8032, 13817, 1483, 15134, 60, 330, 2688, 11450, 1, 505, 220, 679, 22, 596, 1472, 15037, 12839, 70408, 374, 459, 7294, 48587, 479, 56664, 11, 43676, 330, 543, 279, 1234, 81134, 304, 279, 1917, 1, 311, 2567, 11039, 17706, 17153, 60, 323, 330, 26208, 6187, 1, 39377, 279, 12697, 315, 279, 50313, 337, 79549, 31926, 8032, 16596, 60, 10139, 380, 12149, 30411, 37475, 83168, 304, 74615, 369, 330, 82, 23635, 58, 287, 60, 27136, 922, 13650, 814, 82577, 3062, 11, 1524, 304, 264, 15692, 8396, 3343, 58, 17014, 60, 33600, 4987, 16526, 4872, 17781, 96660, 3502, 1071, 25, 330, 4959, 315, 279, 8254, 3697, 68341, 304, 264, 1648, 430, 374, 837, 311, 5678, 323, 279, 2324, 568, 6944, 311, 3974, 13, 11205, 62684, 323, 24142, 74809, 15481, 24743, 11, 4221, 11, 7829, 11, 323, 14673, 61046, 17609, 2595, 72603, 198, 6334, 4652, 25, 41333, 5536, 315, 83168, 198, 2520, 27927, 10401, 315, 420, 8712, 11, 1518, 16526, 32418, 382, 33, 10155, 16785, 520, 279, 12126, 7424, 35206, 73169, 47784, 304, 12366, 389, 6664, 220, 975, 11, 220, 679, 23, 198, 1966, 5936, 220, 1682, 11, 220, 679, 24, 11, 4212, 14756, 7086, 83168, 832, 315, 279, 220, 1041, 1455, 32549, 1274, 315, 279, 1060, 11, 55402, 1124, 279, 330, 3617, 31176, 315, 10466, 3343, 58, 18633, 60, 67293, 11145, 8211, 73822, 86288, 1098, 84, 6497, 7863, 279, 1912, 596, 10383, 311, 430, 315, 279, 55957, 8032, 17887, 60, 386, 7532, 2956, 11145, 73046, 38208, 53977, 10555, 430, 330, 37241, 83168, 15058, 956, 279, 1176, 311, 1825, 279, 14365, 311, 735, 9483, 454, 15603, 11, 814, 1051, 279, 1176, 311, 3719, 21391, 13, 2435, 1541, 956, 1120, 14638, 311, 3995, 1274, 719, 1101, 311, 279, 220, 1135, 82, 323, 220, 1399, 82, 4325, 38462, 61046, 13679, 60, 578, 1176, 2536, 12, 23392, 12365, 10255, 311, 1304, 279, 8121, 29459, 21964, 304, 220, 679, 23, 11, 83168, 574, 279, 2132, 1888, 48724, 13820, 15603, 4028, 5361, 3772, 15771, 11, 2132, 1193, 311, 42865, 8032, 16546, 1483, 17590, 1483, 16522, 60, 763, 220, 2366, 15, 11, 83168, 6244, 279, 1176, 2536, 38702, 944, 323, 2536, 12, 23392, 12365, 10255, 311, 387, 7086, 11812, 1932, 596, 8121, 61647, 29459, 315, 279, 9941, 8032, 13341, 60, 763, 4987, 12126, 11, 83168, 41853, 369, 220, 3174, 13, 24, 3346, 315, 8176, 6763, 304, 279, 1176, 4376, 315, 220, 679, 24, 11, 709, 505, 872, 3157, 4430, 315, 220, 914, 13, 18, 3346, 279, 3766, 1060, 8032, 17451, 2595, 644, 220, 2366, 17, 11, 1472, 3458, 13818, 7633, 83168, 439, 3515, 41963, 63600, 279, 16526, 32418, 11, 14393, 279, 3728, 14800, 315, 16526, 7829, 439, 13750, 439, 41118, 1550, 304, 279, 3766, 13515, 323, 449, 279, 8333, 315, 10383, 430, 279, 16192, 17768, 27875, 4987, 16526, 4632, 94137, 635, 1047, 304, 220, 2366, 15, 8032, 12901, 60, 4987, 12126, 596, 8792, 6201, 11, 279, 8715, 315, 12126, 11, 1766, 304, 220, 2366, 16, 430, 83168, 11, 2737, 264, 330, 83473, 2515, 1, 430, 5343, 7319, 32083, 311, 4987, 12126, 26, 7319, 2802, 304, 16526, 7829, 11, 9698, 11, 323, 4007, 315, 279, 16526, 4221, 26, 323, 3779, 13489, 2326, 3, 20, 7239, 824, 1060, 311, 4987, 12126, 596, 8752, 11, 264, 6650, 315, 922, 220, 15, 13, 20, 3346, 8032, 18061, 60, 362, 220, 679, 23, 4007, 8710, 430, 11, 389, 5578, 11, 220, 4728, 11, 931, 48512, 824, 1060, 1047, 12263, 4987, 12126, 927, 279, 3347, 3116, 1667, 369, 83168, 14228, 8125, 8032, 17678, 2595, 54, 32929, 11054, 83168, 439, 6164, 1524, 4315, 1023, 7701, 32549, 735, 41352, 5315, 1778, 439, 20666, 6, 24367, 11, 7445, 31870, 11, 1398, 78, 11, 94666, 11, 323, 5348, 64349, 58, 19746, 60, 323, 5296, 430, 83168, 596, 2450, 5039, 279, 12939, 315, 264, 3831, 11, 4642, 8571, 2385, 304, 279, 4325, 315, 3674, 3772, 11, 1405, 8571, 55927, 649, 387, 439, 3062, 439, 18273, 4367, 311, 264, 5609, 596, 2450, 8032, 18634, 60, 578, 1912, 706, 1101, 39575, 5694, 520, 279, 52301, 315, 279, 2626, 3185, 315, 279, 735, 41352, 5064, 555, 34118, 2753, 58096, 17517, 449, 872, 6373, 2883, 311, 35608, 872, 32692, 4113, 488, 323, 28697, 8032, 8652, 1483, 18113, 60, 3161, 420, 26627, 5603, 311, 7076, 6373, 11, 83168, 3549, 12401, 20405, 311, 279, 4987, 16526, 12822, 323, 15253, 3927, 488, 323, 54348, 4315, 872, 10877, 8032, 10465, 2595, 35, 10567, 316, 2826, 198, 644, 813, 220, 2550, 15, 9071, 25046, 7572, 11, 5054, 28568, 15466, 452, 9188, 8040, 279, 7434, 315, 264, 2132, 955, 315, 2410, 2204, 505, 8776, 59021, 2191, 8032, 16482, 60, 452, 9188, 6267, 11, 330, 2028, 2132, 13189, 315, 2410, 1389, 902, 13980, 994, 832, 3224, 5334, 1023, 5961, 311, 1390, 1148, 433, 6944, 1389, 2643, 387, 2663, 1080, 57212, 535, 477, 8579, 2410, 304, 13168, 449, 279, 2653, 477, 3290, 2410, 315, 22106, 3885, 311, 656, 1148, 433, 6944, 61046, 17228, 60, 59250, 1778, 439, 386, 8039, 3489, 434, 569, 617, 9435, 279, 7434, 315, 8579, 2410, 311, 83168, 323, 872, 10383, 389, 16924, 62340, 323, 6625, 4398, 8032, 18384, 60, 1472, 3458, 13818, 323, 386, 8039, 3489, 434, 569, 682, 1373, 279, 11667, 315, 8579, 2410, 439, 2737, 7829, 11, 5054, 2819, 11, 323, 7362, 4947, 11, 902, 17208, 311, 83168, 596, 5845, 311, 387, 1080, 57212, 535, 304, 872, 5603, 311, 31135, 872, 1984, 315, 26348, 11, 26586, 11, 323, 28118, 2324, 596, 97737, 4669, 872, 7353, 14638, 389, 279, 6625, 6566, 8032, 18384, 22414, 33, 10155, 323, 4900, 13142, 38180, 520, 279, 5929, 4783, 389, 3297, 220, 2148, 11, 220, 2366, 17, 627, 33, 10155, 574, 18719, 311, 2686, 279, 3723, 19687, 3331, 12000, 304, 1561, 4356, 304, 6250, 220, 679, 23, 8032, 17306, 1483, 18349, 60, 3011, 1890, 1060, 814, 10887, 304, 12366, 1603, 459, 10877, 315, 220, 3443, 11, 2737, 4900, 17781, 96660, 3502, 323, 1023, 7510, 11, 520, 279, 220, 679, 23, 12126, 7424, 35206, 73169, 47784, 11, 264, 30048, 32689, 279, 11919, 4398, 1990, 9822, 323, 4987, 12126, 8032, 18520, 60, 3011, 1060, 11, 83168, 6244, 279, 39637, 34876, 315, 279, 7365, 315, 41333, 8930, 275, 13, 18185, 13042, 60082, 36342, 1694, 2728, 311, 34876, 449, 927, 220, 868, 1667, 315, 26501, 11, 17781, 15324, 279, 1912, 11, 4330, 1667, 1139, 872, 7076, 11, 369, 872, 19564, 304, 31135, 16526, 7829, 323, 4221, 15603, 8032, 17112, 1483, 19192, 60, 763, 6250, 220, 679, 24, 11, 83168, 1051, 9932, 555, 17781, 1418, 38787, 15174, 369, 279, 2262, 19647, 11, 369, 3515, 96734, 18699, 2626, 4211, 1555, 2167, 10758, 449, 7359, 8032, 6843, 60, 763, 220, 2366, 15, 11, 83168, 4036, 279, 7957, 362, 13, 13000, 44555, 17768, 304, 18324, 315, 872, 19310, 19564, 311, 279, 20862, 315, 2326, 16222, 61148, 4398, 11, 279, 39637, 5954, 461, 288, 311, 5371, 279, 10292, 8032, 18277, 1483, 18509, 60, 763, 5887, 220, 2366, 16, 11, 814, 1051, 21489, 9984, 42855, 38139, 2303, 369, 12781, 2672, 811, 323, 21023, 555, 4900, 17781, 13, 763, 872, 3560, 439, 665, 3415, 1065, 11, 814, 1520, 311, 330, 19223, 17985, 389, 3728, 84029, 11, 1778, 439, 22556, 4500, 11, 311, 1057, 3938, 22540, 323, 311, 20259, 279, 7140, 596, 34616, 2410, 4028, 279, 1917, 37964, 18199, 60, 323, 5101, 520, 6625, 4455, 1778, 439, 279, 220, 4767, 339, 3723, 19687, 3331, 12000, 8032, 15951, 60, 1952, 3297, 220, 2148, 11, 220, 2366, 17, 11, 83168, 12263, 2326, 4900, 13142, 38180, 520, 279, 5929, 4783, 311, 4358, 279, 3293, 10205, 304, 7294, 12, 68540, 12491, 17073, 323, 21934, 8032, 12676, 2595, 37, 2255, 198, 11439, 311, 23727, 2234, 10320, 359, 13818, 11, 83168, 596, 10205, 574, 72849, 555, 264, 2294, 5376, 304, 4731, 2835, 15840, 323, 15652, 389, 13674, 323, 279, 5108, 315, 459, 49014, 32447, 11, 2737, 22480, 438, 3876, 315, 2536, 38827, 950, 3956, 11, 3953, 11, 323, 18884, 17422, 11, 439, 1664, 439, 459, 14800, 315, 2930, 4731, 75425, 8032, 18044, 60, 578, 1912, 706, 264, 3544, 11, 7701, 17057, 11, 2930, 4029, 315, 7359, 3967, 439, 6395, 19708, 320, 2654, 25745, 38366, 386, 732, 13, 369, 30160, 705, 902, 48018, 279, 1912, 596, 24142, 323, 3674, 3772, 8158, 1139, 1023, 15823, 323, 9248, 48801, 19564, 315, 83168, 596, 3697, 13, 1666, 315, 220, 2366, 15, 11, 1063, 220, 1272, 3610, 6395, 19708, 3697, 18447, 311, 279, 7200, 596, 13674, 5613, 11, 449, 810, 1109, 220, 966, 3610, 2768, 279, 4033, 83168, 6405, 323, 14318, 9815, 8032, 5833, 60, 578, 8571, 4029, 8779, 7068, 83168, 596, 1396, 19101, 9676, 33407, 4669, 47672, 21343, 389, 17265, 15771, 17706, 18775, 60, 439, 1664, 439, 41802, 311, 4668, 83168, 596, 4731, 389, 9063, 17789, 323, 12707, 8032, 19057, 60, 4427, 6395, 19708, 3697, 1253, 1524, 53120, 279, 1912, 5196, 304, 10383, 4315, 83168, 7359, 8032, 19929, 22414, 76887, 520, 279, 83168, 1917, 7364, 21497, 364, 29351, 60005, 6, 304, 9853, 12167, 389, 6250, 220, 21, 11, 220, 679, 23, 627, 33, 10155, 16681, 291, 323, 17045, 449, 872, 20723, 505, 872, 30758, 2919, 4669, 3674, 3772, 17706, 14648, 60, 439, 1664, 439, 4669, 83168, 29849, 11, 459, 25631, 51728, 16239, 279, 3697, 3309, 1555, 4731, 6946, 11, 6505, 3953, 11, 6603, 11, 2875, 12631, 11, 323, 810, 430, 6835, 7359, 3130, 311, 46820, 553, 8032, 18650, 60, 13818, 12090, 430, 6395, 19708, 527, 15107, 311, 83168, 2533, 279, 3697, 527, 3970, 439, 1234, 81134, 11, 71373, 505, 279, 16526, 47967, 323, 264, 12309, 9099, 16526, 16924, 2883, 11, 902, 6276, 3995, 7359, 311, 10765, 449, 1124, 8032, 17662, 60, 83168, 596, 24142, 6604, 311, 3674, 2819, 11, 323, 7359, 6013, 555, 4560, 311, 7417, 279, 1917, 13, 1666, 264, 1121, 11, 279, 75425, 15870, 83487, 55280, 389, 48801, 11384, 323, 41589, 55096, 32360, 4819, 1778, 439, 34267, 58187, 11, 19739, 21934, 11, 2911, 596, 3268, 11, 10182, 2349, 11, 323, 279, 20562, 12, 777, 28522, 8032, 18017, 1483, 18265, 1483, 12935, 60, 37957, 505, 6395, 19708, 311, 83168, 22223, 279, 1912, 596, 6299, 323, 24142, 26, 83168, 706, 34373, 3738, 16526, 4339, 430, 5222, 1093, 3778, 19739, 1776, 1759, 505, 872, 11936, 323, 9670, 20632, 449, 264, 11002, 17276, 994, 16526, 6395, 19708, 3697, 25660, 813, 6325, 14560, 8032, 18322, 2595, 3976, 4987, 16526, 3229, 55551, 82279, 12336, 11, 279, 5133, 1990, 83168, 323, 6395, 19708, 374, 330, 64, 27848, 9473, 1990, 13820, 323, 872, 7359, 1, 430, 374, 922, 810, 1109, 16632, 330, 729, 1711, 279, 7200, 596, 9036, 2826, 498, 719, 1101, 330, 428, 2518, 279, 7200, 596, 1984, 315, 98042, 1139, 279, 1917, 3343, 12336, 1200, 1572, 430, 83168, 323, 6395, 19708, 527, 330, 64, 7891, 315, 2349, 304, 78258, 79500, 11, 539, 1120, 315, 1803, 1697, 2349, 3343, 58, 10898, 60, 578, 7200, 3697, 5694, 7655, 323, 617, 1317, 26579, 872, 7359, 6, 3560, 304, 872, 2450, 8032, 19166, 60, 10771, 311, 21077, 32602, 11, 330, 33, 10155, 81658, 264, 4545, 315, 1803, 1697, 18475, 13, 6395, 19708, 11105, 264, 364, 5065, 315, 4325, 6, 369, 279, 3995, 11, 304, 902, 13042, 5788, 323, 10383, 527, 3728, 323, 23222, 11, 323, 1405, 279, 12822, 527, 31205, 323, 40418, 17045, 61046, 19867, 2595, 11663, 66724, 198, 3812, 11073, 1392, 198, 6334, 4652, 25, 41333, 5536, 315, 83168, 17036, 4060, 11073, 1392, 198, 33, 10155, 53319, 449, 393, 13722, 7314, 304, 220, 679, 20, 11, 15453, 439, 393, 13722, 12126, 596, 6883, 96662, 1603, 24050, 311, 3728, 96662, 304, 220, 679, 23, 11, 323, 22923, 279, 57466, 315, 393, 13722, 596, 330, 38062, 258, 1, 323, 330, 59837, 3612, 1, 1584, 15603, 8032, 13897, 1483, 19162, 1483, 18781, 60, 763, 220, 679, 24, 11, 83168, 8667, 449, 435, 10746, 311, 19507, 1202, 10775, 2332, 686, 8032, 19230, 60, 83168, 706, 1101, 10434, 439, 3728, 6883, 96662, 369, 24294, 38784, 6, 36122, 17706, 12910, 60, 323, 60940, 37792, 6, 220, 679, 24, 43772, 39773, 279, 330, 20577, 285, 1037, 37964, 18695, 60, 323, 35784, 10633, 2849, 9249, 39773, 11, 279, 330, 45, 78309, 3343, 58, 16481, 60, 83168, 6244, 3728, 96662, 315, 279, 9249, 8761, 22019, 4101, 31922, 469, 311, 12192, 1268, 9249, 11731, 649, 1520, 12896, 10182, 2349, 8032, 20062, 60, 763, 220, 2366, 15, 11, 83168, 53319, 449, 18907, 38784, 17706, 19081, 60, 28965, 264, 7347, 83168, 57689, 2373, 315, 279, 20238, 328, 508, 10, 323, 20238, 426, 29088, 10, 8032, 20422, 60, 1666, 279, 1176, 8762, 2477, 1912, 3596, 311, 51696, 449, 423, 2521, 11, 83168, 10775, 291, 665, 41794, 505, 13818, 12201, 6, 5075, 7424, 543, 220, 679, 24, 4526, 520, 872, 21497, 520, 800, 1037, 409, 9822, 8032, 15515, 60, 578, 7200, 6244, 3728, 6883, 96662, 369, 12140, 650, 3159, 783, 304, 5936, 220, 2366, 16, 8032, 19631, 2595, 30690, 32329, 18237, 198, 6334, 4652, 25, 7302, 32329, 18237, 315, 83168, 198, 33, 10155, 527, 3967, 369, 872, 58738, 45036, 79645, 13, 26778, 3697, 315, 279, 7200, 617, 1027, 304, 55015, 1139, 41385, 25968, 19424, 11, 1778, 439, 279, 6781, 5604, 37, 16958, 1105, 10349, 323, 279, 7997, 49687, 10349, 11, 304, 68023, 315, 279, 1404, 323, 11900, 315, 872, 24910, 8032, 19695, 1483, 18252, 1483, 20077, 60, 2435, 617, 1101, 4036, 23146, 369, 872, 24910, 11, 449, 832, 4562, 12588, 264, 90500, 315, 279, 17979, 17768, 369, 24910, 311, 279, 19071, 17706, 19498, 60, 323, 83168, 439, 264, 4459, 12588, 264, 6781, 5604, 37, 31016, 556, 17768, 369, 872, 10919, 3092, 726, 4901, 13, 2435, 3629, 33009, 38171, 11, 449, 872, 36380, 425, 3010, 1694, 1903, 586, 555, 279, 11351, 814, 1862, 323, 279, 3772, 8032, 19695, 1483, 19615, 60, 578, 7200, 596, 9045, 617, 27762, 872, 7359, 311, 1101, 16988, 304, 5370, 48801, 323, 38748, 7640, 11, 323, 389, 13402, 1524, 2489, 872, 24910, 8032, 20698, 2595, 14945, 337, 3536, 198, 6334, 4652, 25, 1796, 315, 23146, 323, 60698, 4036, 555, 83168, 198, 33, 10155, 617, 4036, 12387, 23146, 6957, 872, 7076, 13, 2435, 617, 20503, 332, 3210, 2834, 279, 67293, 10948, 17768, 369, 7054, 9983, 29459, 2533, 220, 679, 22, 26, 527, 279, 1193, 735, 41352, 1912, 311, 3243, 7054, 74312, 14, 2878, 11, 520, 279, 220, 679, 24, 67293, 10948, 23488, 26, 58, 19838, 60, 323, 527, 279, 1455, 12, 675, 21632, 1912, 304, 18772, 4940, 3925, 439, 315, 220, 2366, 17, 11, 449, 220, 717, 15160, 8244, 8032, 18572, 60, 83168, 527, 1101, 279, 1193, 735, 41352, 1912, 311, 3243, 40822, 74312, 477, 5856, 1389, 10466, 19945, 1197, 323, 40822, 9983, 29459, 520, 279, 3778, 10948, 23488, 17706, 3443, 60, 323, 6244, 279, 1176, 14875, 1180, 304, 279, 1501, 596, 3925, 311, 3243, 29459, 315, 279, 9941, 304, 220, 2366, 16, 8032, 10841, 60, 2435, 527, 279, 1176, 16526, 2477, 1180, 311, 5371, 264, 74679, 17768, 29804, 17706, 16496, 60, 323, 279, 1176, 16526, 10255, 311, 387, 39048, 369, 264, 5567, 17768, 8032, 13074, 60, 3161, 220, 966, 23146, 8244, 11, 2737, 264, 3335, 3116, 24871, 15160, 369, 29459, 315, 279, 9941, 320, 39563, 705, 83168, 527, 279, 1455, 12, 675, 21632, 7362, 10255, 304, 279, 3925, 315, 279, 6457, 7573, 11997, 23488, 13, 2435, 617, 1101, 4036, 264, 2860, 315, 220, 1135, 54544, 520, 279, 386, 39200, 23488, 8032, 7507, 60, 128009, 128006, 78191, 128007, 271], text: 

@CatherineSue
Copy link
Contributor Author

Did a bit deep dive, when in streaming and for the first few chunks with empty generation, it executes this line: https://github.com/vllm-project/vllm/blob/main/vllm/sequence.py#L531. It returns the cached_token_ids, and with num_new_tokens=0, it just returns the prompt_token_ids. Not sure if this is the right behavior tho.

@njhill njhill self-assigned this Oct 1, 2024
@CatherineSue
Copy link
Contributor Author

CatherineSue commented Oct 2, 2024

@njhill I tried to change https://github.com/vllm-project/vllm/blob/main/vllm/sequence.py#L531 to:

        if num_new_tokens == 0:
            return []

        return self.data._cached_all_token_ids[-num_new_tokens:]

It fixed both logprobs and the completion_tokens usage info issue I mentioned.

But I don't think it is the correct fix. Since the logic there seems tricky. Kindly ask for your input. Thanks!

@njhill
Copy link
Member

njhill commented Oct 2, 2024

@CatherineSue sorry for the delay, I will look at this today.

@njhill
Copy link
Member

njhill commented Oct 2, 2024

@njhill I tried to change https://github.com/vllm-project/vllm/blob/main/vllm/sequence.py#L531 to:

        if num_new_tokens == 0:
            return []

        return self.data._cached_all_token_ids[-num_new_tokens:]

It fixed both logprobs and the completion_tokens usage info issue I mentioned.

But I don't think it is the correct fix. Since the logic there seems tricky. Kindly ask for your input. Thanks!

@CatherineSue actually this is the correct fix I think! This is why negative indexing is a bit precarious.

Would you like to open another PR with this? It would be great to have a unit test for this case too.

Thanks for finding the bug.

@CatherineSue
Copy link
Contributor Author

@njhill thank you for verifying. Opened a PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
3 participants