LectureSummarizer/RAG.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# (abandoned, too small documents)Creating RAG from scratch\n",
    "\n",
    "\n",
    "https://docs.llamaindex.ai/en/stable/examples/low_level/oss_ingestion_retrieval.html"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Postgresql with pgvector dockerfile\n",
    "```\n",
    "version: \"3.6\"\n",
    "\n",
    "services:\n",
    "  postgres-pgvector:\n",
    "    image: ankane/pgvector:latest\n",
    "    container_name: postgres-pgvector\n",
    "    restart: always\n",
    "    volumes:\n",
    "      - postgres_pgvector_volume:/var/lib/postgresql/data\n",
    "    ports:\n",
    "      - 5432:5432\n",
    "    environment:\n",
    "      POSTGRES_USER: martin\n",
    "      POSTGRES_PASSWORD: password123\n",
    "volumes:\n",
    "  postgres_pgvector_volume:\n",
    "  ```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "import psycopg2\n",
    "\n",
    "db_name = \"vector_db\"\n",
    "host = \"localhost\"\n",
    "password = \"password\"\n",
    "port = \"5432\"\n",
    "user = \"user\"\n",
    "# conn = psycopg2.connect(connection_string)\n",
    "conn = psycopg2.connect(\n",
    "    dbname='postgres',\n",
    "    host=host,\n",
    "    password=password,\n",
    "    port=port,\n",
    "    user=user,\n",
    ")\n",
    "conn.autocommit = True\n",
    "\n",
    "with conn.cursor() as c:\n",
    "    c.execute(f\"DROP DATABASE IF EXISTS {db_name}\")\n",
    "    c.execute(f\"CREATE DATABASE {db_name}\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sqlalchemy import make_url\n",
    "from llama_index.vector_stores.postgres import PGVectorStore\n",
    "\n",
    "vector_store = PGVectorStore.from_params(\n",
    "    database=db_name,\n",
    "    host=host,\n",
    "    password=password,\n",
    "    port=port,\n",
    "    user=user,\n",
    "    table_name=\"transcription\",\n",
    "    embed_dim=384,  # openai embedding dimension\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Use a Text Splitter to Split Documents"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [],
   "source": [
    "from llama_index.core.node_parser import SentenceSplitter\n",
    "\n",
    "text_parser = SentenceSplitter(\n",
    "    chunk_size=1024,\n",
    "    # separator=\" \",\n",
    ")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [],
   "source": [
    "from llama_index.core import SimpleDirectoryReader\n",
    "\n",
    "reader = SimpleDirectoryReader(input_dir=\"./txt_files/\")\n",
    "documents = reader.load_data()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[Document(id_='1e1bcc2c-7b59-4755-ba9f-5906148167b0', embedding=None, metadata={'file_path': '/home/jrosh/Projects/whispertest/txt_files/test_audio_shell_lecture.txt', 'file_name': 'test_audio_shell_lecture.txt', 'file_type': 'text/plain', 'file_size': 45833, 'creation_date': '2024-03-21', 'last_modified_date': '2024-03-21'}, excluded_embed_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], excluded_llm_metadata_keys=['file_name', 'file_type', 'file_size', 'creation_date', 'last_modified_date', 'last_accessed_date'], relationships={}, text=\" All right, everyone. Thanks for coming in. This is the missing semester of your CS education. At least that's what we chose to call the class. If you're not here for this class, then you're in the wrong room. We will be here for about an hour, just to set your expectations. And I want to talk to you a little bit first about why we're doing this class. So this class stems out of an observation that Anish and Jose and I have made while TAing various classes at MIT, which is that basically all of us computer scientists, we know that computers are great at doing these repetitive tasks and automating things. But we often fail to realize that there are lots of tools that can make our own development processes better. We can be a lot more efficient about how we use our computers, because we can use the computer as a tool for ourselves, not just for building websites or software, those sorts of things. And this class is an attempt to address this, is an attempt to show you some of the tools that you can use to great effect in your day-to-day, in your research, and in your studies. And it's going to be a class where we want you to teach you both how to make the most of the tools that you already know, but also hopefully teach you about some tools you don't know from before, and how to combine those tools to produce more powerful things than you think you might be able to do with what you know today. The class is going to be structured as a series of 11 one-hour lectures. And each one is going to cover a particular topic. You can see the website, which is also listed there, for the list of lecture topics and what date will do each one. They will mostly be independent. And so you can show up for the ones that you're interested in. But we will assume that you've been following along, so that as we get to later lectures, I'm not going to be teaching you bash all over again, for example. We are also going to post both the lecture notes and recordings of the lectures online. Exactly when we do that, we haven't established yet, but it will be after the lectures. Obviously, the videos have to be posted after. The class is going to be run by me, John, and Anish, sitting over there. And Jose, who is not currently here, but will be holding tomorrow's lecture. And keep in mind that we're trying to cover a lot of ground over the course of just 11 one-hour lectures. And so we will be moving relatively rapidly. But please do stop us if there's anything where you feel like you're not following along. If you feel like there's something you wish we would spend more time on, just let us know. Please interrupt us with questions. And also, after each lecture, we're going to hold office hours on the ninth floor of Building 32, the Stata Center, the Computer Science Building. So if you show up in the ninth floor lounge there and the Gates Tower, then you can come and try some of the exercises that we give for each lecture, or just ask us other questions about things we've talked about in lecture or other things about using your computer efficiently. Due to the limited time that we have available, we're not going to be able to cover all tools in full detail. And so what we'll try to do is highlight interesting tools and interesting ways to use them. We won't necessarily dig into the deep details about how all of it works or more elaborate use cases. But if you have questions about them, please come ask us about that too. Many of these tools are tools that we have used for years. And we might be able to point you to additional interesting things you can do with them. So take advantage of the fact that we're here. This class is going to, I don't want to say ramp up quickly, but what's going to happen over the course of this particular lecture is it will cover many of the basics that we assume that you will know for the rest of the semester, things like how to use your shell and your terminal. And I'll explain what those are to those who are not familiar with them. And then we'll pretty quickly ramp up into more advanced tools and how to use them. You can already see from the lecture notes the kind of topics that we're going to be covering. And so that brings us to today's lecture, in which we are going to cover the shell. And the shell is going to be one of the primary ways that you interact with your computer once you want to do more things than what the sort of visual interfaces you might be used to allow you to do. The visual interfaces are sort of limited in what they allow you to do because you can only do the things that there are buttons for, sliders for, input fields for. Often these textual tools are built to be both composable with one another, but also to have tons of different ways to combine them or ways to program and automate them. And that is why in this class we will be focusing on these command line or text-based tools. And the shell is the place that you will do most of this work. So for those of you who are not familiar with the shell, most platforms provide some kind of shell. On Windows, this is often PowerShell, but there are also other shells available on Windows. On Linux, you will find tons of terminals. These are Windows that allow you to display shells. And you also find many different types of shells, the most common of which is bash or the born-again shell. Because it's such a common shell, it is the one we're primarily going to be covering in these lectures. If you're on macOS, you will probably also have bash, maybe an older version of it if you open the terminal app. And so if you want to follow along on any of these platforms, feel free. But keep in mind that most of this is going to be sort of Linux-centric in terms of how we teach it, even though most of these tools work on all the platforms. If you want to install a terminal in a shell and you don't know how to do it, well, we're happy to show you at office hours. Or it's usually very easy to just Google your platform plus terminal, and you will get one. Now, when you open a terminal, you get something that looks a little bit like this. So it will usually have just a single line at the top. And this is what's known as the shell prompt. You can see that my shell prompt looks like this. It has my username, the name of the machine that I'm on, the current path I'm on. And we will talk about paths a little bit later. And then it's really just sort of blinking there, asking me for input. And this is the shell prompt where you tell the shell what you want it to do. And you can customize this prompt a lot. And when you open it on your machine, it might not look exactly like this. It might look something like this, if you've configured it a little, or it might look all sorts of different ways. We won't go too much into customizing your shell in this particular lecture. We'll do that later. Here, we're just going to talk about how do you use this shell to do useful things. And this is sort of the main textual interface you have to your computers through this shell. On the shell prompt, you get to write commands. And commands can be relatively straightforward things. Usually, it'll be something like executing programs with arguments. What does that look like? Well, one program we can execute is the date program. We just type date to present her. And then it will show you unsurprisingly the date and time. You can also execute a program with arguments. This is one way to modify the behavior of the program. So for example, there's a program called echo. And echo just prints out the arguments you give it. And arguments are just white space separated things that follow the program name. So we can say hello. And then it will print hello back. Perhaps not terribly surprising, but this is the very basics of arguments. One thing that you'll notice is that I said that arguments are separated by white space. And you might wonder, well, what if I want an argument that's multiple words? You can also quote things. So you can do things like echo hello space world. And now the echo program receives one argument that contains the string hello world with a space. You can also use single quotes for this. And the difference between single quotes and double quotes we'll get back to when we talk about bash scripting. You can also just escape single characters. So for example, hello world. This will also work just fine. All of these rules about how you escape and how you parse and quote various arguments and variables will cover a little bit later. Hopefully you won't run into too many oddities about this. Just keep in mind at least that space is separate arguments. So if you want to do something like make a directory called my photos, you can't just type make directory my photos. It will create two directories, one called my and one called photos. And that is probably not what you want. Now, one thing you might ask is how does the shell know what these programs are? When I type date or when I type echo, how does it know what these programs are supposed to do? And the answer to this is your computer has a bunch of built in programs that comes with the machine. Just like your machine might chip with the terminal app or it might chip with Windows Explorer or it might chip with some kind of browser. It also ships with a bunch of terminal-centric applications. And these are stored on your file system. And your shell has a way to determine where a program is located. It basically has a way to search for programs. It does this through something called an invariant environment variable. An environment variable is a variable like you might be used to for programming languages. It turns out that the shell and the born-again shell in particular is really a programming language. This prompt that you're given here is not just able to run a program with arguments. You can also do things like while loops, for loops, conditionals. You can define functions. You can have variables. And all of these things you can do in the shell. We'll cover a lot of that in the next lecture on shell scripting. For now, though, let's just look at this particular environment variable. Environment variables are things that are set whenever you start your shell. They're not things you have to set every time you run your shell. There are a bunch of these that are set things like, where is your home directory? What is your username? And there's also one that's critical for this particular purpose, which is the path variable. So if I echo out dollar path, this is going to show me all of the paths on my machine that the shell will search for programs. You'll notice that this is a list that is colon separated. It might be kind of long and hard to read. But the essentials is that bash, whenever you type the name of a program, is going to search through this list of paths on your machine. And it's going to look in each directory for a program or a file whose name matches the command you try to run. So in my case, when I try to run data echo, it's going to walk through these one at a time until it finds one that contains a program called data echo, and then it's going to run it. If we want to know which one it actually runs, there's a command called which, which lets us do that. So I can type which echo, and it will tell me that if I were to run a program called echo, I would run this one. It's worth pausing here to talk about what paths are. So paths are a way to name the location of a file on your computer. On Linux and Omac OS, these paths are separated by slashes, forward slashes. So you'll see here that this is in the root directory. So the slash at the very beginning indicates that this is starting from the top of the file system. Then look inside the directory called usr. Then look inside the directory bin, and then look for the file called echo. On Windows, paths like this are usually separated by back slashes instead. And where on Linux and Mac OS, everything lives under the root namespace, so all paths start with a slash or all absolute paths. On Windows, there is one root for every partition. So you might have seen things like c colon backslash or d colon backslash. So Windows has separate file system path hierarchies for each drive that you have. Whereas on Linux and Mac OS, these are all mounted under one namespace. You'll notice that I said the word absolute path, and you might not know what that means. So absolute paths are paths that fully determine the location of a file. So in this case, this is talking only about a specific echo file, and it's giving you the full path to that file. But there are also things known as relative paths. So a relative path is relative to where you currently are. And so the way we find out where we currently are is you can type PWD for present working directory. Present? Print working directory. So if I type PWD, it will print out the current path that I'm in. So currently, I'm in the home directory under the root, and then John under that, and then Dev under that, et cetera. From here, I can then choose to change my current working directory. And all relative paths are relative to the current working directory, which is basically where you currently are. In this case, for example, I can do CD slash home. CD is change directory. This is the way that I change what my current working directory is. In this case, I change to home, and you'll see my shell prompt change to say that I am now in home. It just gives me the name of the last segment of the path, but you can also configure your terminal to give you the full path whenever you're anywhere. And now if I type PWD again, it will tell me I'm in slash home. There are also a couple of special directories that exist. There is dot and dot dot. Dot means the current directory. Dot dot means the parent directory. So this is a way that you can easily navigate around the system. For example, here, if I type CD dot dot, it will tell me that I am now in slash. So I'm now in the root of the file system. I was in slash home, now I'm in slash. And indeed, if I type PWD, it will do that right thing. And I can also then use relative paths to go down into the file system. So I can do CD dot slash home. And this is going to CD into the home directory under the current directory. So this will bring me back to slash home. If I now tried CD dot slash home again, it will say there's no such directory. Because there is no home directory under the current directory I'm on, which I changed by doing CD. And I can sort of CD all the way back to the place that I was using relative paths. And I can also do things like dot dot dot dot dot dot dot to get back to somewhere deep in my file system. This happens to be all the way back to the root. So here, there's a bin directory. And under bin, there's an echo file. And so then I can do world. And that runs the echo program under bin. So this is a way that you can construct paths to arbitrarily traverse your file system. Sometimes you want absolute paths, and sometimes you want relative ones. Usually, you want to use whichever one is shorter. But if you want to, for example, run a program or write a program that runs a program, like echo or date, and you want it to be able to be run from anywhere, you either want to just give the name of the program, like data echo, and let the shell use the path to figure out where it is, or you want to give it absolute path. Because if you gave a relative path, then if I ran it in my home directory, and you ran it in some other directory, it might work for me, but not for you. In general, when we run a program, it is going to be operating on the current working directory, at least by default, unless we give it any other arguments. And this is really handy, because it means that often we don't have to give full paths for things. We can just use the name of files in the directory that we're currently in. One thing that's really useful is to figure out what is in the current directory we're in. So we already saw Pwd, which prints where you currently are. There's a command called ls, which will show you, it will list the files in the current directory. So if I type ls here, this is all the files in the current directory. And this is a handy way to just quickly navigate through the file system. You'll see that if I sort of cd dot dot and then do ls, it will show me the files in that directory instead. But with ls, I can also give it ls dot dot. I can give it a path, and then it will ls that file instead of the one that I'm currently in, or ls that directory. And you can see this if I go all the way to the root as well. Root has different files. One handy trick you might not know about here is there are two other special things you can do. One is the tilde character, this character, brings you to your home directory. So tilde always expands to the home directory. And you can do relative paths to it. So I can do tilde slash dev slash pedos classes missing semester, and now I'm there. Because tilde expanded to slash home slash john. There is also, for cd in particular, a really handy argument you can give, which is dash. If you do cd dash, it will cd to the directory you were previously in. So if I do cd dash, I go back to root. If I do cd dash again, I go back to missing semester. So this is a handy way if you want to toggle between two different directories. In the case of ls or in the case of cd, there might be arguments that you don't know about. Currently, we haven't really been doing anything except giving paths. But how do you even discover that you can give a path to ls in the first place? Well, most programs take what are known as arguments like flags and options. These are things that usually start with a dash. One of the handiest one of these is dash dash help. Most programs implement this. And if you run, for example, ls dash dash help, it will helpfully print out a bunch of information about that command. And you'll see here that it says the usage is ls, and you can give some number of options, and you can give some number of files. The way to read that usage line is triple dot means like zero or one or more, and the square bracket means optional. So in this case, there's an optional number of options, and there's an optional number of files. And you'll see that it says what the program does, and also specifies a number of different types of flags and options you can give. Usually, we call things that are a single dash and a single letter a flag, or anything that doesn't take a value of flag, and anything that does take a value an option. So for example, dash a and dash all are both flags, and dash c or dash color is an option. One thing you'll see under here, if you scroll down far enough, is the dash l flag. That's unhelpful. The dash l flag. The dash l flag uses a long listing format, not that that's particularly helpful in and of itself, but let's see what it actually does. So if I do ls dash l, it still prints the files in the current directory, but it gives me a lot more information about those files. And this is something you'll find yourself using quite a lot, because the additional information it gives you is often quite handy. Let's look at what some of that information is. So first of all, the d at the beginning of some of these entries indicate that something is a directory. So the underscore data entry here, for example, is a directory, whereas 404.html is not a directory, it's a file. The following letters after that indicate the permissions that are set for that file. So like we saw earlier, I might not be able to open a given file, or I might not be able to cd into a given directory, and this is all dictated by the permissions on that particular file or directory. The way to read these is that the first group of three are the permissions that are set for the owner of the file. All of these files you'll see are owned by me. The second group of three characters is for the permissions for the group that owns this file. In this case, all of these files are also owned by the John group. And a final group of three is a list of the permissions for everyone else, so anyone who's not a user owner or a group owner. This directory is perhaps kind of boring, because all of the things are owned by me. But if we do something like cd to slash and do ls-l, you'll see that here all of them are owned by root. We'll get back to what the root user is. But here you'll see some of the permissions are a little bit more interesting. The groups of three are read, write, and execute. What these mean differs for files and for directories. For files, it's pretty straightforward. If you have read permissions on a file, then you can read its contents. If you have write permissions on a file, then you can save the file. You can add more to it, or you can replace it entirely. And if you have execute the xbit on a file, then you're allowed to execute that file. So if we do ls-l in slash bin, that's an helpful. In user bin, you'll see that all of them have the execute bit set, even for people who are not the owner of the file. And this is because the echo program, for example, we want everyone on the computer to be able to execute. There's no reason to say only certain users can run echo. That doesn't really make any sense. For directories, though, these permissions are a little bit different. So read translates to, are you allowed to see which files are inside this directory? So think of read as list for a directory. Are you allowed to list its contents? Write for a directory is whether you are allowed to rename, create, or remove files within that directory. So it's still kind of write, but notice that this means that if you have write permissions on a file, but you do not have write permissions on its directory, you cannot delete the file. You can empty it, but you cannot delete it, because that would require writing to the directory itself. And finally, execute on directories is something that trips people up a lot. Execute on a directory is what's known as search. And that's not terribly helpful a name. But what that means is, are you allowed to enter this directory? If you want to get to a file, if you want to open it, or read it, or write it, whatever you want to do, basically to CD into a directory, you must have the execute permission on all parent directories of that directory and the directory itself. So for example, for me to access a file inside slash user slash bin, such as user bin echo, I must have execute on root, I must have execute on user, and I must have execute on bin. If I do not have all those execute bits, I will not be allowed to access that file, because I won't be able to enter the directories along the way. There are a number of other bits that you might come across, like you might see Ss or Ts in these lists. You might see Ls. Those we can talk about in office hours, if you're curious. They will mostly not matter for anything you will do in this class. But they are handy to know about. So if you're curious about them, look them up on your own, or come ask us in office hours. There are some other programs that are handy to know about. Oh, sorry, there's one more thing I should mention. If you just have a dash, it means you do not have that permission. So if it says, for example, r-x, it means that you have read and execute, but you do not have write. There are some other handy programs to know about at this point. One of them is move, or the MV command. So if I CD back to missing semester here, MV lets me rename a file. And rename here takes two paths. It takes the old path and the new path. This means that move lets you both rename a file, like if you change the name of the file but not the directory, or it lets you move a file to a completely different directory. It just gives you the path to the current file and the path to where you want that file to be. And that can change its location and its name. So for example, I can move .files.md to be foo.md, unhelpfully. And similarly, I can move it back. There's also the cp command. The cp, or copy, is very similar. It lets you copy a file. cp also takes two arguments. It takes the path that you want to copy from and the path that you want to copy to. And these are full paths. So I could use this, for example, to say I want to copy .files.md to ..files.md. Sure, foo.md. And now if I do ls.dot, you'll see that there's a foo.md file in that directory. So cp as well takes two paths that does not have to be in the same directory. And similarly, there's the rm command, which lets you remove a file. And there, too, you can give paths. In this case, I'm removing .dot slash foo. You should be aware, for removing, especially on Linux, removal is by default not recursive. So you cannot remove a directory using rm. You can pass the dash r flag, which lets you do a recursive remove, and then give a path that you want to remove, and it will remove everything below it. There is also the rmdir command, which lets you remove a directory, but it only lets you remove that directory if it is empty. So the idea here is to sort of be a safety mechanism for you so you don't accidentally throw away a bunch of your files. And the final little command that's handy to use is makedir, which lets you create a new directory. And as we talked about before, you don't want to do something like this, because it will create two directories for you, one called my and one called photos. If you actually want to create a directory like this, you would either escape the space or quote the string. If you ever want more information about how any command, basically, on these platforms work, there's a really handy command for that as well. There is the program called man for manual pages. This program takes as an argument the name of another program and gives you its manual page. So for example, we could do manls. And this shows us a manual page for ls. You'll notice that in the case of ls, it is fairly similar to what we got with ls-help. But it's a little easier to navigate and a little easier to read. Usually towards the bottom, you will also get examples, information about who wrote it, where you can find more information, and that sort of stuff. One thing that can be confusing sometimes, at least until a recent version where they added this string at the bottom where it says, cue to quit. They do not use to say this. You press cue to quit this program. It can be really hard to quit it if you do not know that. A handy keyboard shortcut here, by the way, is control l, which lets you clear your terminal and go back to the top. So far, we've only talked about programs in isolation. But where much of the power of the shell really comes through is once you start combining different programs. So rather than just running CD, running ls, et cetera, you might want to chain multiple programs together. You might want to interact with files and have files operate in between programs. And the way we can do this is using this notion of streams that the shell gives us. Every program by default has, I'm going to simplify a little and say, two primary streams. It has an input stream and an output stream. By default, the input stream is your keyboard. Basically, the input stream is your terminal. And whatever you type into your terminal is going to end up into the program. And it has a default output stream, which is whenever the program prints something, it's going to print to that stream. And by default, that is also your terminal. This is why when I type echo hello, it gets printed back to my terminal. But the shell gives you a way to rewire these streams, to change where the input and output of a program are pointed. The most straightforward way you do this is using the angle bracket signs. So you can write something like this, or you can write something like this. The left angle bracket indicates rewire the input for this program to be the contents of this file. And the end angle bracket means rewire the output of the preceding program into this file. So let's look at an example of what that would look like. If I do echo hello, I can say I want that content to be stored in a file called hello.text. And because I gave this as a relative path, this will construct a file in the current directory called hello.text. And at least in theory, its contents should be the word hello. So if I run this, notice that nothing got printed to my output. The previous time when I ran echo hello, it printed hello. Now that hello has gone into a file called hello.text. And I can verify this by using the program called cat. So cat prints the contents of a file. So I can do cat hello.text. And there it shows me hello. But cat is also something that supports this kind of wiring. So I can say cat, which by default just prints its input, just duplicates its input to its output. I can say I want you to take your input from hello.text. What will happen in this case is that the shell is going to open hello.text, take its contents, and set that to be the input of cat. And then cat is going to just print that to its output, which since I haven't rewired it, it's just going to be my terminal. So this will just print hello to the output. And I can use both of these at the same time. So for example, if I want to copy a file and I don't want to use the cp command for some reason, I can do this. And in this case, I'm telling the cat program nothing at all. I'm just saying, do your normal thing. The cat program does not know anything about this redirection. But I'm telling the shell to use hello.text as the input for cat, and to write anything that cat prints to hello to.text. Again, this prints nothing to my terminal. But if I cat hello to.text, I get the output as I would have expected, which is a copy of the original file. There is also a double end bracket, which is append instead of just overwrite. So you'll notice that if I do cat hello.text to hello to.text again, and then I cat hello to.text, it still just contains hello, even though it already contained hello. If I switch that to instead be a double end bracket, it means append. And if I now cat that file, it has hello twice. These are pretty straightforward. They're usually just ways to interact with files. But where it gets really interesting is an additional operator the shell gives you called the pipe character. So pipe is just a vertical bar. And what pipe means is take the output of the program to the left, and make it the input of the program to the right. So what does this look like? Well, let's take the example of ls-l slash. This prints a bunch of things. Let's say that I only wanted the last line of this output. Well, there's a command called tail, and tail prints the last n lines of its input. And I can do dash n1. So this is a flag called n. You can also use dash dash lines if you want to use it as a longer option. But in this case, this is saying just print the last line. And I can wire these together. So I can say ls-l slash pipe tail dash n1. And notice here that ls does not know about tail. And tail does not know about ls. They are different programs and have never been programmed to be compatible with one another. All they know how to do is read from input and write to output. And then the pipe is what wires them together. And in this particular case, I'm saying I want the output of ls to be the input to tail, and that I want the output of tail to just go to my terminal, because I haven't rewired it. I could also rewire this to say I want the output to go to ls.text. And in this case, if I cat ls.text, I would get the appropriate output. And it turns out you can do some really neat things with this. We're going to cover this a lot more in the data wrangling lecture that will be in, I think, four days or something, on the kind of fancy stuff you can do when you start building more advanced pipelines. To give you one example, we can do something like curl dash dash head, silent Google.com. So just to show you what that looks like, this gives me all the HTTP headers for accessing Google.com. And I can pipe that to grep dash ignore case or just dash i if I want, content length. So this is going to print the content length header. grep is a program that we'll talk about later that lets you search in an input stream for a given keyword. We can pipe that through, say, the cut command, which takes a delimiter. Set that to be space. And I want the second field. And this prints just the content length. This is sort of a silly example, right? Like this just lets you extract the content length in bytes of Google.com from the command line. It is not a very useful thing to do. But you can see how by chaining these together, you can achieve a bunch of really interesting text manipulation effects. And it turns out pipes are not just for textual data. You can do this for things like images as well. You can have a program that manipulates a binary image on its input and writes a binary image to its output. And you can change them together in this way. And we'll talk about some of those kinds of examples later on, too. You can even do this for video if you want. You can stream. This is, for example, a great way if you have a Chromecast at home. You can stream a video file like this. By having the last program in your pipe be a Chromecast send program. So you stream a video file into it, and it streams over HTTP to your Chromecast. We'll talk a lot more about this in the data wrangling lecture. But there's one more thing that I wanted to talk to you about sort of how to use the terminal in a more interesting and perhaps more powerful way that you might be used to. And this is perhaps even going to be interesting for the ones of you who feel like you're already comfortable with the terminal. But first, we need to cover an important topic when it comes to Linux systems and Mac OSes, in particular, which is the notion of the root user. The root user is sort of like the administrator user on Windows, and it has user ID 0. The root user is special because it is allowed to do whatever it wants on your system. Even if a file is not readable by anyone, or if it's not writable by anyone, root can still access that file. Root is sort of a super user that gets to do whatever they want. And most of the time, you will not be operating as the super user. You will not be root. You will be a user like John or whatever your name is, and that's going to be the user you act with. Because if you were operating your computer as the root user at all times, if you ran the wrong program, it could just completely destroy your computer. You don't want that. But every now and again, you want to do something that requires that you are root. Usually for these cases, you will use a program called sudo, S-U-D-O. Or do as su, and su in this case is super user. So this is a way to do the following thing as the super user. Usually the way sudo works is you write sudo, and then a command like you would normally on your terminal. And it will just run that command as if you were root as opposed to the user you actually are. Where might you need something like this? Well, there are many special file systems on your computer, but in particular, there's one called sysfs. If you cd to slash sys, this is a whole new world. This file system are not actually files on your computer. Instead, these are various kernel parameters. So the kernel is basically the core of your computer. This is a way for you to access various kernel parameters through what looks like a file system. You'll see here that if I cd into class, for example, it has directories for a bunch of different types of devices that I can interact with, or various cues I can access, or all sorts of weird knobs internally. And because they're exposed as files, it means we can also use all the tools we've been using so far in order to manipulate them. One example of this is if you go into sysclass, backlight. So this backlight directory lets you configure the backlight on your laptop if you have one. So I can cd into Intel backlight. This is an Intel laptop. Inside here, you'll see there's a file called brightness. And I can cat the brightness. This is the current brightness of my screen. But not only that, I can modify this too in order to change the brightness of my screen. So you might think that I could do, let's see what the max brightness is here. OK, so it's currently set to the max brightness. You might imagine that I could do something like, if I do echo, let's do half or something, echo 500 to brightness. If I do this, it says permission denied. I'm not allowed to modify brightness because basically in order to change things in the kernel, you need to be the administrator. And you might imagine that the way to solve this is to write sudo echo 500. But I still get a permission denied error. But why is that? It's because, as I mentioned before, these redirections of input and output is not something the programs know about. When we piped LS into tail, tail did not know about LS. And LS did not know about tail. The pipe and the redirection was set up by the shell. So in this case, what's happening is I'm telling my shell, run the program sudo with the arguments echo and 500, and send its output to the file called brightness. But the shell is what is opening the brightness file. It is not the sudo program. So in this case, the shell which is running as me tries to open the brightness file for writing, and it's not allowed to do that. And therefore, I get a permission denied error. You might have seen this if you search for something, end up on Stack Overflow, and it tells just run this command. And you'll see that it does something like, they give you instructions like 1, 2, sys, what's an example, net IPv4 forward, for example. This is something you may have seen if you're setting up a firewall. And this command is intended to work because this little pound symbol indicates run this as root. This is something that is very rarely explained, but that is what the pound symbol means. You'll see on my prompt, there's a dollar symbol instead, and the dollar indicates you are not running as root. So the question is, how do I get around this? Well, I could switch into a root terminal. So one way to do this is to run sudo su. sudo su is saying, run the following command as root, and su is a complicated command that effectively gets you a shell as the super user. So if I do this, type a password, then now you'll see that the username at the beginning changed from John to root, and the prompt changed from a dollar to a pound. If I now echo into that file, if I do echo 500 to brightness, my screen got a little dimmer, but you can't see it. You just have to trust me. And now, I didn't get an error. And this is because the shell is now running as root. It is not running as John. And the root user is allowed to open this file. But given our knowledge that we have of the terminal now, there's actually a way for us to do this without having to drop to a root shell. And that is as follows. Let's, I guess, restore it to 1060. So do you see why this is different? Here, I'm telling my shell to run the echo 1060 command, which is going to echo 1060. And I'm telling it to run the sudo t brightness command. And I'm telling you to send the output of echo into sudo t. In order to understand this, you need to know what the t command does. The t command takes its input and writes it to a file, but also to standard out. So t is a convenient way if you have, say, a log file that you want to send to a file to store for later, but you also want to see it yourself. Then you can pipe it through t, give it the name of a file, and it will write whatever its input is, both to that file and to your screen. And here, I'm taking advantage of that program. I'm saying, run t as root and have t write into the brightness file. And so in this case, the t program, which is what is opening the brightness file, is running as root. And so it is allowed to do this. If I run this, it will now, again, you can't see, but the brightness has now been turned on by a laptop. And I don't get any errors. And I never had to drop into a root shell and run commands there, which can often be somewhat dangerous. If you want to explore this file system a little bit more, there's a lot of interesting stuff in here. If you just sort of start browsing around, you can find all sorts of fun things. So for example, we notice that there was a fun brightness command here. I wonder what other kinds of brightness I can set. So I can use the find command, which we'll also talk about in a coming lecture. I want to look at any file whose name is a little like brightness in the current directory. That's unhelpful. Maybe they're not files. Did I misspell brightness? Why is it being annoying? Apparently, it does not want to search for brightness for me. Oh, well. Luckily for you, I know of one already. Handy that. There is a sub directory called LEDs. And LEDs have brightness, too. What kind of LEDs are there? Ooh, lots of things. For example, the scroll lock LED. Now, most of you probably don't know what the scroll lock LED is or much less what scroll lock is. But you might have seen a key on your keyboard named scroll lock. Basically, no one knows what it means anymore. No one really uses it for anything. It's mostly just a dead key and also a dead LED. What if you wanted to configure it so that every time you get email, your scroll lock LED lights up? Because there's no other reason why it would light up. Well, if we see you into this particular directory, there's a brightness place. And it's set to zero. Well, what happens if I write one into it? You probably should not just be writing random numbers into random files in this directory because you are affecting your kernel directly. Like, look up what the files do. In this particular case, I have worn safety goggles and I have done my research. So now, you can't tell. But on my keyboard, the scroll lock LED is now lit. So now, if I wrote a program that did some checking of mail and stuff, I could have it at the end run a program that echoes one into this file. And now, I have a way for my LED to my keyboard to indicate when I have new email. At this point, you should know roughly your way around the terminal, around the shell, and know enough to accomplish at least basic tasks. At least in theory now, you shouldn't need to use point and click interfaces to find files anymore. There's one remaining trick you might need. And that is the ability to open a file. So far, I've only really given you ways to find files. But one thing you should know about is, amazing semester, xdg-open. This will probably only work on Linux. On macOS, I think it's just called open. On Windows, who knows. xdg-open, you give the name of a file and it will open it in the appropriate program. So if you do xdg-open an HTML file, it will open your browser and open that file. And once you have that program, in theory, you should no longer need to open a finder window ever again. You might want to for other reasons. But in theory, you can accomplish it all using the tools that we've learned today. This might all seem relatively basic for some of you. But as I mentioned, this is the ramp up period of now we all know how the shell works. And a lot of what we'll be doing in future lectures is using this knowledge to do really interesting things, using the shell. This is learning the interface that we're going to be using. And so it's important we all know it. We're going to talk a lot more in the next lecture about how to automate tasks like this, how to write scripts that run a bunch of programs for you, and how to do things like conditionals and loops and stuff in your terminal, and do things like run a program until it fails. It can be handy in classes where you want to run something until your test suite fails, for example. So that's the topic for next week's lecture. Did you have a question? Yeah, just related to what you've been demoing in the Sys directory, that presumably will only work if you're still booting into Linux, not if you're running Windows subsystems for Linux. That is a good question. I don't know whether the Windows subsystem for Linux will expose a Sys file system. If it does, it probably only exposes a very small number of things. It might. Because there are s- Do you have the LEDs on the screen for instance, for example? I don't know. Check it out. One thing you'll see is the lecture notes for this lecture are already online. And at the very bottom of the file, there are a bunch of exercises. Some of them are relatively easy. Some of them are a little bit harder. And what we encourage you to do is to take a stab at going through them. If you know this stuff already, it should go really quickly. If you don't, it might teach you a bunch of things that you might not realize you didn't know. And for the office hours that we're going to do right after this lecture, we will happily help you get through all of those. Or if there are other commands you learn in the process, you want to know how to use more efficiently. And then in next lecture, which is tomorrow, we'll basically be assuming that you know the kind of stuff that the exercise is going to teach you. There's also an email address on the website where you can send us questions if you think of something like after the office hours are finished. Are there any questions before we end today? No? No? All right. Well, we will have office hours on the ninth floor of the Gates Building of Building 32 in like five minutes. Sweet. See you there. Oh, hello.\", start_char_idx=None, end_char_idx=None, text_template='{metadata_str}\\n\\n{content}', metadata_template='{key}: {value}', metadata_seperator='\\n')]"
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "documents"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [],
   "source": [
    "text_chunks = []\n",
    "# maintain relationship with source doc index, to help inject doc metadata in (3)\n",
    "doc_idxs = []\n",
    "for doc_idx, doc in enumerate(documents):\n",
    "    cur_text_chunks = text_parser.split_text(doc.text)\n",
    "    text_chunks.extend(cur_text_chunks)\n",
    "    doc_idxs.extend([doc_idx] * len(cur_text_chunks))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Node ID: 14f41cf9-be80-49ba-868a-7f37b3e38d16\n",
      "Text: All right, everyone. Thanks for coming in. This is the missing\n",
      "semester of your CS education. At least that's what we chose to call\n",
      "the class. If you're not here for this class, then you're in the wrong\n",
      "room. We will be here for about an hour, just to set your\n",
      "expectations. And I want to talk to you a little bit first about why\n",
      "we're doing this ...\n",
      "Node ID: 8101c9f5-8442-4091-8b76-00e60c602825\n",
      "Text: So take advantage of the fact that we're here. This class is\n",
      "going to, I don't want to say ramp up quickly, but what's going to\n",
      "happen over the course of this particular lecture is it will cover\n",
      "many of the basics that we assume that you will know for the rest of\n",
      "the semester, things like how to use your shell and your terminal. And\n",
      "I'll explain...\n",
      "Node ID: 460abd75-0511-4b31-8820-d911e93d2746\n",
      "Text: Usually, it'll be something like executing programs with\n",
      "arguments. What does that look like? Well, one program we can execute\n",
      "is the date program. We just type date to present her. And then it\n",
      "will show you unsurprisingly the date and time. You can also execute a\n",
      "program with arguments. This is one way to modify the behavior of the\n",
      "program. So ...\n",
      "Node ID: 587950ab-a80e-400e-9c15-d1c16c4101f5\n",
      "Text: And it's going to look in each directory for a program or a file\n",
      "whose name matches the command you try to run. So in my case, when I\n",
      "try to run data echo, it's going to walk through these one at a time\n",
      "until it finds one that contains a program called data echo, and then\n",
      "it's going to run it. If we want to know which one it actually runs,\n",
      "there...\n",
      "Node ID: 130eb2a3-9983-4202-b41c-8c597805f966\n",
      "Text: So this will bring me back to slash home. If I now tried CD dot\n",
      "slash home again, it will say there's no such directory. Because there\n",
      "is no home directory under the current directory I'm on, which I\n",
      "changed by doing CD. And I can sort of CD all the way back to the\n",
      "place that I was using relative paths. And I can also do things like\n",
      "dot dot dot ...\n",
      "Node ID: 80baa32c-cdc4-4d17-b39a-d489a545c8ad\n",
      "Text: Well, most programs take what are known as arguments like flags\n",
      "and options. These are things that usually start with a dash. One of\n",
      "the handiest one of these is dash dash help. Most programs implement\n",
      "this. And if you run, for example, ls dash dash help, it will\n",
      "helpfully print out a bunch of information about that command. And\n",
      "you'll see here ...\n",
      "Node ID: bf515203-34f3-4e22-bdf8-fc6124a2cd06\n",
      "Text: And this is because the echo program, for example, we want\n",
      "everyone on the computer to be able to execute. There's no reason to\n",
      "say only certain users can run echo. That doesn't really make any\n",
      "sense. For directories, though, these permissions are a little bit\n",
      "different. So read translates to, are you allowed to see which files\n",
      "are inside this d...\n",
      "Node ID: 270e1688-9486-4a5a-8939-d5ca03da48bb\n",
      "Text: So cp as well takes two paths that does not have to be in the\n",
      "same directory. And similarly, there's the rm command, which lets you\n",
      "remove a file. And there, too, you can give paths. In this case, I'm\n",
      "removing .dot slash foo. You should be aware, for removing, especially\n",
      "on Linux, removal is by default not recursive. So you cannot remove a\n",
      "direc...\n",
      "Node ID: 54d752f7-7a15-4fb4-b00f-4bbc68461a5e\n",
      "Text: And the end angle bracket means rewire the output of the\n",
      "preceding program into this file. So let's look at an example of what\n",
      "that would look like. If I do echo hello, I can say I want that\n",
      "content to be stored in a file called hello.text. And because I gave\n",
      "this as a relative path, this will construct a file in the current\n",
      "directory called hel...\n",
      "Node ID: 130343bb-f5bd-45a4-8dfe-705d03c4689b\n",
      "Text: And then the pipe is what wires them together. And in this\n",
      "particular case, I'm saying I want the output of ls to be the input to\n",
      "tail, and that I want the output of tail to just go to my terminal,\n",
      "because I haven't rewired it. I could also rewire this to say I want\n",
      "the output to go to ls.text. And in this case, if I cat ls.text, I\n",
      "would get the...\n",
      "Node ID: a46ab156-5566-4fe7-8ce6-bff7942f2f56\n",
      "Text: But every now and again, you want to do something that requires\n",
      "that you are root. Usually for these cases, you will use a program\n",
      "called sudo, S-U-D-O. Or do as su, and su in this case is super user.\n",
      "So this is a way to do the following thing as the super user. Usually\n",
      "the way sudo works is you write sudo, and then a command like you\n",
      "would norm...\n",
      "Node ID: f33e6e5a-bf2a-4a7a-b55d-03036cf354eb\n",
      "Text: So the question is, how do I get around this? Well, I could\n",
      "switch into a root terminal. So one way to do this is to run sudo su.\n",
      "sudo su is saying, run the following command as root, and su is a\n",
      "complicated command that effectively gets you a shell as the super\n",
      "user. So if I do this, type a password, then now you'll see that the\n",
      "username at the...\n",
      "Node ID: d3679e34-7326-4352-8c1b-0eb4cb4329db\n",
      "Text: It's mostly just a dead key and also a dead LED. What if you\n",
      "wanted to configure it so that every time you get email, your scroll\n",
      "lock LED lights up? Because there's no other reason why it would light\n",
      "up. Well, if we see you into this particular directory, there's a\n",
      "brightness place. And it's set to zero. Well, what happens if I write\n",
      "one into i...\n",
      "Node ID: 65273962-dc48-46d9-af4a-575477db7906\n",
      "Text: If you know this stuff already, it should go really quickly. If\n",
      "you don't, it might teach you a bunch of things that you might not\n",
      "realize you didn't know. And for the office hours that we're going to\n",
      "do right after this lecture, we will happily help you get through all\n",
      "of those. Or if there are other commands you learn in the process, you\n",
      "want ...\n"
     ]
    }
   ],
   "source": [
    "from llama_index.core.schema import TextNode\n",
    "\n",
    "nodes = []\n",
    "for idx, text_chunk in enumerate(text_chunks):\n",
    "    node = TextNode(\n",
    "        text=text_chunk,\n",
    "    )\n",
    "    src_doc = documents[doc_idxs[idx]]\n",
    "    node.metadata = src_doc.metadata\n",
    "    print(node)\n",
    "    nodes.append(node)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {},
   "outputs": [],
   "source": [
    "# sentence transformers\n",
    "from llama_index.embeddings.huggingface import HuggingFaceEmbedding\n",
    "\n",
    "embed_model = HuggingFaceEmbedding(model_name=\"BAAI/bge-small-en-v1.5\")\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[-0.060712628066539764, -0.02310643345117569, 0.011446606367826462, -0.0703437477350235, 0.04156683385372162, -0.031214579939842224, -0.031966645270586014, 0.004196931608021259, -0.008774680085480213, -0.051531944423913956, 0.04007921740412712, 0.010612113401293755, 0.013570002280175686, -0.028641855344176292, 0.06293020397424698, 0.012507150880992413, 0.0074752443470060825, -0.0321357399225235, -0.01604590378701687, 0.0011007589055225253, 0.025750016793608665, -0.012666643597185612, -0.007408031262457371, -0.03456125035881996, 0.002670475048944354, 0.02272435836493969, 0.08327215164899826, -0.07686217129230499, -0.005974041763693094, -0.18700295686721802, 0.013395211659371853, -0.014004806987941265, 0.065121129155159, -0.011722243390977383, 0.01375389564782381, -0.027596743777394295, 0.04479644075036049, -0.01723567768931389, -0.09018917381763458, 0.01304884348064661, 0.00887093972414732, -0.003886748105287552, 0.02116154134273529, -0.0008597108535468578, 0.035171810537576675, -0.05673332139849663, -0.009529152885079384, -0.0676899179816246, 0.014873459935188293, -0.032115161418914795, -0.08062111586332321, -0.02541905641555786, -0.022706303745508194, -0.00348502304404974, -0.050529737025499344, 0.01764567755162716, 0.06912889331579208, 0.05640631914138794, -0.0165533609688282, -0.027654586359858513, -0.05070538446307182, 0.003042597556486726, -0.1168537437915802, 0.08519627153873444, 0.03867378458380699, 0.0035086204297840595, -0.0024651591666042805, -0.0452827624976635, 0.045123279094696045, 0.08385869115591049, -0.054388344287872314, -0.021010538563132286, -0.02229238860309124, 0.11286283284425735, 0.01098302099853754, -0.015603429637849331, 0.04392635077238083, 0.024248603731393814, 0.030695993453264236, -0.05955820530653, -0.06548573076725006, -0.03930169343948364, 0.04986777901649475, -0.023890158161520958, 0.009504745714366436, -0.025820747017860413, 0.0012954011326655746, 0.013239140622317791, -0.0163464043289423, 0.0025127825792878866, 0.00031638136715628207, -0.04753368720412254, 0.03792928531765938, 0.011726424098014832, -0.01352748554199934, -0.02635507844388485, 0.009810222312808037, 0.06946565955877304, 0.0008483970304951072, 0.4598373770713806, -0.03963812068104744, -0.028167948126792908, 0.0416882149875164, -0.009044545702636242, -0.006132919806987047, -0.029930587857961655, 0.07440181076526642, 0.0323142446577549, 0.03829854354262352, -0.01777392253279686, 0.035020701587200165, -0.023712920024991035, 0.030685558915138245, -0.043757691979408264, 0.0010578848887234926, 0.01366814412176609, 0.05745703727006912, -0.000853253121022135, -0.0019595534540712833, -0.007526280824095011, 0.013412193395197392, -0.0047812252305448055, 0.015453619882464409, -0.038567833602428436, 0.06800173968076706, -0.09721605479717255, -0.0005331600550562143, 0.07069618254899979, 0.02133050002157688, 0.027533864602446556, 0.03500872850418091, -0.03669075667858124, 0.005565536208450794, -0.009015084244310856, 0.046682074666023254, 0.01359495334327221, -0.04670236259698868, -0.007568433415144682, 0.021853528916835785, -0.02189057320356369, 0.031195249408483505, 0.03774288669228554, 0.010982226580381393, -0.03348976746201515, -0.07199356704950333, 0.06900518387556076, 0.008757426403462887, 0.030728880316019058, -0.005579706281423569, -0.031821902841329575, 0.019632110372185707, -0.028180697932839394, 0.01406186819076538, -0.05427590757608414, -0.0002026040165219456, -0.006376577541232109, 0.08186900615692139, 0.03477618470788002, -0.0495389960706234, -0.026166904717683792, -0.049312006682157516, -0.019158806651830673, -0.005045311991125345, 0.07944685965776443, 0.09370477497577667, -0.0028266014996916056, -0.02397933043539524, 0.012400484643876553, 0.03610527142882347, -0.05390917509794235, 0.005010930821299553, 0.006901961285620928, 0.01050215307623148, 0.009752055630087852, 0.08879321813583374, -0.03833020105957985, -0.03869409114122391, -0.010705353692173958, 0.01793128438293934, 0.037207409739494324, 0.022157495841383934, -0.013826313428580761, -0.05919146165251732, 0.0019191495375707746, -0.026870187371969223, 0.001570465974509716, -0.03959164023399353, 0.007635419722646475, -0.014163460582494736, 0.05452635511755943, -0.00804486870765686, 0.02561303600668907, -0.013436052948236465, -0.012884276919066906, -0.07664406299591064, -0.023830145597457886, 0.07183659076690674, -0.05024049058556557, -0.04143908992409706, -0.022378958761692047, 0.038148943334817886, 0.01589706353843212, -0.0066115716472268105, 0.018183156847953796, -0.05089283362030983, -0.0361454114317894, 0.05649161711335182, -0.005706272553652525, 0.06203782558441162, 0.024256598204374313, -0.05261876806616783, -0.03964516893029213, 0.0037018482107669115, 0.0022952493745833635, -0.012467153370380402, -0.033870089799165726, 0.02445339784026146, 0.018699385225772858, 0.0026643495075404644, 0.03247305750846863, -0.02539331652224064, 0.02836369164288044, -0.06382714211940765, -0.3103724420070648, -0.01600603386759758, 0.003492215648293495, -0.01223737932741642, 0.06897275149822235, -0.043641626834869385, 0.04004213586449623, -0.0039171380922198296, 0.006170651409775019, -0.02217349410057068, 0.09354835748672485, -0.026926398277282715, 0.012718988582491875, -0.09096860885620117, 0.012697761878371239, -0.006103252060711384, 0.0006690600421279669, -0.05002578720450401, -0.07103949785232544, -0.013693646527826786, -0.02228683792054653, 0.011307977139949799, -0.0043527972884476185, -0.07111077010631561, 0.010138770565390587, 0.00883936695754528, 0.05611022934317589, 0.0025272388011217117, 0.11987511813640594, 0.035291895270347595, 0.043698783963918686, 0.02913508005440235, 0.023289963603019714, -0.09281156212091446, -0.0198839008808136, 0.011863987892866135, 0.0465165451169014, -0.020575741305947304, 0.019611502066254616, -0.015695730224251747, -0.026769449934363365, -0.018624980002641678, -0.02393227070569992, -0.05953792482614517, -0.01920432411134243, -0.04326653480529785, -0.025321947410702705, 0.009928997606039047, -0.02151847630739212, 0.01181134581565857, -0.004175673238933086, -0.014043964445590973, -0.004936091136187315, 0.004492294974625111, -0.010406604036688805, -0.04182497784495354, 0.0028050474356859922, -0.0316157191991806, -0.0007589847082272172, 0.02379465103149414, 0.04027562215924263, 0.04252232611179352, -0.004645547363907099, -0.022502025589346886, 0.021421115845441818, -0.01779446005821228, -0.007805005181580782, -0.01606863923370838, 0.03727766498923302, -0.03291995823383331, -0.05044541135430336, -0.0016780656296759844, 0.023396668955683708, -0.0015200349735096097, 0.03766842186450958, -0.019687902182340622, 0.023112675175070763, 0.040059495717287064, -0.01595373824238777, -0.020041819661855698, 0.048681870102882385, -0.004496085457503796, 0.0145854027941823, 0.031204983592033386, 0.03815365582704544, 0.011296593584120274, 0.04989827051758766, 0.008388889953494072, 0.010883211158216, 0.04821053519845009, -0.05971325933933258, 0.0022957974579185247, -0.028225691989064217, -0.004204575903713703, 0.05840423330664635, 0.02486322447657585, -0.26433002948760986, -0.01898781768977642, 0.04487527534365654, 0.0585487075150013, -0.007454439997673035, -0.02828582189977169, 0.054761987179517746, -0.06305842846632004, -0.028894536197185516, 0.030715608969330788, 0.04433845356106758, 0.013195095583796501, 0.0019645753782242537, -0.020676588639616966, 0.05321592837572098, -0.006382741034030914, 0.12281490117311478, -0.00921607855707407, -0.03007443994283676, 0.013985469937324524, -0.014777899719774723, -0.007606151979416609, 0.14827542006969452, -0.008763963356614113, 0.08802056312561035, 0.0029831540305167437, 0.0013113286113366485, -0.04802372306585312, 0.07493674755096436, 0.0042866808362305164, 0.03619971126317978, -0.03961847722530365, 0.011395706795156002, -0.05528208613395691, -0.0411737784743309, -0.024389851838350296, -0.019930358976125717, 0.057835325598716736, -0.0038510432932525873, -0.007604741025716066, 0.004853014834225178, -0.043319590389728546, -0.030564429238438606, -0.007268293295055628, 0.0554947666823864, -0.012083418667316437, 0.007183380890637636, -0.09610210359096527, -0.012517793104052544, -0.003663058392703533, 0.04266897961497307, -0.025413112714886665, 0.014546802267432213, -0.009085090830922127, 0.011076434515416622, 0.08600928634405136, -0.013708984479308128, -0.00455516530200839, -0.022669056430459023, -0.033460915088653564, 0.04587090387940407, 0.01748456060886383, 0.07784915715456009, 0.0500803142786026, 0.025947419926524162]\n",
      "[-0.047384537756443024, -0.018704239279031754, 0.004939247388392687, -0.07933496683835983, 0.015604467131197453, -0.034681614488363266, -0.030483830720186234, -0.014290992170572281, -0.04317374899983406, -0.03657206892967224, 0.0066555640660226345, 0.015752466395497322, -0.004921221639961004, -0.02317582443356514, 0.05798373371362686, -0.016487998887896538, 0.03873496875166893, -0.03521643951535225, -0.005120896268635988, -0.006861542817205191, 0.004192954394966364, 0.029699312523007393, 0.0007663046126253903, -0.016416985541582108, -0.026064977049827576, 0.05368128418922424, 0.0540519617497921, -0.04741588234901428, 0.0038039989303797483, -0.18248848617076874, 0.026372522115707397, 0.006766199599951506, 0.02632666379213333, -0.015057260170578957, -0.0006601394270546734, -0.02291606366634369, 0.02073594368994236, -0.011963668279349804, -0.052459195256233215, 0.013035064563155174, 0.03148399293422699, -0.0026608433108776808, 0.011467657051980495, -0.0007504291133955121, 0.01848192885518074, -0.06534656882286072, -0.023129068315029144, -0.08243869990110397, 0.06624431163072586, -0.04868248477578163, -0.030602725222706795, -0.0028514419682323933, 0.007915780879557133, -0.03358420729637146, -0.05162674933671951, -0.024263454601168633, 0.06286501884460449, 0.08623089641332626, -0.012444986961781979, -0.007460785564035177, -0.05101203918457031, 0.01430415827780962, -0.12676294147968292, 0.094446562230587, 0.03736502304673195, -0.003213265910744667, 0.0289254542440176, 0.007424807641655207, 0.008373124524950981, 0.04910443350672722, -0.07330729067325592, -0.02148846909403801, -0.026946647092700005, 0.10750224441289902, -0.012312902137637138, -0.07401067018508911, 0.008808371610939503, -0.002272556535899639, 0.008474772796034813, -0.0556563064455986, -0.05934819206595421, -0.009913461282849312, 0.040152955800294876, -0.03317149356007576, -0.020432207733392715, -0.05269667133688927, -0.026818694546818733, 0.029011966660618782, -0.005213548894971609, -0.005847292952239513, -0.04121660068631172, -0.050054579973220825, 0.040361519902944565, 0.02930554561316967, -0.0010947263799607754, 0.00044481505756266415, 0.03761359304189682, 0.044621631503105164, 0.03435182943940163, 0.3980591297149658, -0.026410141959786415, -0.026969337835907936, 0.04088436812162399, -0.0356108658015728, -0.002123233862221241, -0.0056874705478549, 0.06949041783809662, 0.0403929203748703, 0.043803613632917404, 0.02799098938703537, 0.027948928996920586, -0.02326907590031624, -0.000993040157482028, -0.028724538162350655, 0.015144795179367065, -0.017581887543201447, 0.01623348705470562, -0.002639889484271407, -0.005542093422263861, 9.02831379789859e-05, 0.013765726238489151, -0.0371876060962677, -0.002343696542084217, -0.015004508197307587, 0.10273243486881256, -0.049726635217666626, 0.010928998701274395, 0.03811723738908768, 0.011647532694041729, 0.036058928817510605, 0.02203470468521118, -0.03142956271767616, -0.021031662821769714, -0.021962197497487068, 0.032484814524650574, 0.057437267154455185, -0.026408879086375237, -0.023106027394533157, 0.04553525149822235, -0.05328959599137306, -0.0037561198696494102, -0.02049759402871132, 0.02249537780880928, -0.02186962030827999, -0.049852047115564346, 0.05719660222530365, -0.011359965428709984, 0.04732991009950638, -0.016579661518335342, -0.007897477596998215, 0.038526907563209534, -0.010709250345826149, -0.01840236596763134, -0.028825480490922928, -0.007645755540579557, -0.005574360489845276, 0.09874013811349869, 0.0524379163980484, -0.04970091953873634, -0.011195620521903038, -0.07148053497076035, -0.00922534242272377, 0.010674810968339443, 0.04494704306125641, 0.032661616802215576, -0.00846718531101942, -0.01933177374303341, 0.018158607184886932, 0.04459736868739128, -0.07377942651510239, -0.013611896894872189, 0.005168597213923931, 0.032321590930223465, -0.0011075501097366214, 0.07819722592830658, -0.03321867808699608, -0.035950347781181335, -0.003618032205849886, 0.02594526670873165, 0.03763158246874809, 0.010792545042932034, -0.0518471784889698, -0.05867820605635643, -0.01630588062107563, 0.0005668578669428825, 0.004847316071391106, -0.06314072012901306, 0.019891105592250824, -0.024490738287568092, 0.06315313279628754, 0.03671032190322876, 0.0411004014313221, -0.04689862206578255, -0.014877322129905224, -0.05724448710680008, -0.005957675166428089, 0.04680948331952095, -0.005033932626247406, -0.04278523102402687, 0.00891859270632267, 0.04552200809121132, 0.012522260658442974, -0.003943696618080139, 0.010739815421402454, -0.07149343192577362, -0.08061055094003677, 0.045772943645715714, 0.003254214534536004, 0.07669631391763687, -0.03700481727719307, -0.07402434200048447, -0.0067933350801467896, 0.0021537381689995527, 0.00018985357019118965, -0.04309329763054848, -0.032681141048669815, 0.0018853890942409635, 0.005048219580203295, 0.018185187131166458, 0.027536923065781593, -0.015519359149038792, -0.04984534904360771, -0.04583926126360893, -0.31049999594688416, -0.029023637995123863, 0.010049317963421345, 0.025652535259723663, 0.06866869330406189, -0.07404830306768417, 0.05806095153093338, 0.021776501089334488, -0.03489330783486366, -0.06231649965047836, 0.10385184735059738, -0.0804256945848465, 0.0026031634770333767, -0.06574011594057083, 0.007037855684757233, 0.01757628843188286, 0.0030258449260145426, -0.04865480214357376, -0.059595730155706406, 0.015499615110456944, -0.017134860157966614, -0.039500780403614044, -0.033772796392440796, -0.04029011353850365, -0.013633428141474724, 0.03669311851263046, 0.05255478248000145, -0.00045309829874895513, 0.1147097498178482, 0.03887108340859413, 0.08086778223514557, 0.03947481885552406, -0.024609090760350227, -0.10561969131231308, -0.03266574442386627, 0.032650262117385864, 0.01857614517211914, -0.000910978764295578, 0.015393680892884731, 0.005577069707214832, -0.040443383157253265, 0.008503659628331661, -0.018859190866351128, -0.02624213881790638, -0.03979342058300972, -0.04556870833039284, -0.002476942026987672, 0.01632627472281456, -0.008196216076612473, -0.029929926618933678, 0.002517481567338109, 0.026540296152234077, -0.011369243264198303, -0.029258418828248978, -0.02721031755208969, -0.040593840181827545, 0.022777719423174858, -0.028984148055315018, -0.0013442294439300895, 0.0069707524962723255, 0.06072437763214111, 0.054696131497621536, -0.006023441441357136, -0.01828155852854252, -0.01268862932920456, -0.03314972668886185, -0.02590259723365307, 0.018438875675201416, 0.030565524473786354, -0.0464266762137413, -0.03425778076052666, 0.04099496454000473, -0.006106451153755188, 0.012399096973240376, 0.07024011015892029, 0.022598203271627426, 0.023314880207180977, 0.03474709019064903, -0.01978260651230812, -0.020631233230233192, 0.038297511637210846, 0.015620351769030094, 0.03192446753382683, 0.007511860691010952, -0.005691730882972479, 0.021908044815063477, 0.08313629776239395, -0.0215547326952219, 0.03783262148499489, 6.524944910779595e-05, -0.06390228867530823, -0.034341052174568176, 0.013787179253995419, -0.021219467744231224, -0.002885365393012762, 0.052977800369262695, -0.290886253118515, 0.017948264256119728, 0.05250294879078865, 0.055773716419935226, 0.013921658508479595, -0.014378480613231659, 0.04473012313246727, -0.07070733606815338, -0.007928912527859211, 0.022120816633105278, 0.047159601002931595, 0.03711758926510811, 0.01522910501807928, -0.03662441298365593, 0.045272305607795715, 0.021504538133740425, 0.14934197068214417, -0.0026823319494724274, -0.01581757515668869, 0.010796875692903996, -0.00898182112723589, -0.038435760885477066, 0.1582302749156952, -0.025414464995265007, 0.08452412486076355, -0.044530801475048065, -0.013875847682356834, -0.03020985797047615, 0.056186847388744354, 0.028475768864154816, 0.06063457578420639, -0.014940282329916954, 0.014003311283886433, -0.060650359839200974, -0.03968784585595131, 0.001044124481268227, 0.025669880211353302, 0.06755249202251434, 0.004021141678094864, -0.009773013181984425, -0.010242183692753315, 0.002357069170102477, -0.048219434916973114, -0.027897905558347702, 0.03976492956280708, -0.012210767716169357, 0.018339307978749275, -0.07576046139001846, -0.012132943607866764, 0.03693711385130882, 0.04738127067685127, -0.007325391750782728, 0.00568102952092886, 0.003932962194085121, 0.05567236989736557, 0.051381055265665054, 0.00413269829005003, 0.026008419692516327, -0.01697392389178276, -0.015814466401934624, 0.07147687673568726, 0.0006168904947116971, 0.1022220328450203, 0.06015508994460106, 0.0833199992775917]\n",
      "[-0.07726514339447021, -0.02542981132864952, 0.0070901173166930676, -0.03323158249258995, -0.00827988050878048, -0.07606420665979385, -0.006337856873869896, -0.027248961851000786, -0.003770583076402545, 0.012655695900321007, 0.021683918312191963, 0.047373998910188675, 0.0011884575942531228, -0.005968926474452019, 0.008322649635374546, -0.007714110892266035, -0.02907835692167282, -0.049126047641038895, -0.05159882828593254, 0.0007795515703037381, 0.04497958719730377, 0.054895300418138504, -0.0333864651620388, -0.04300691932439804, 0.01751592941582203, 0.061074066907167435, -0.00040783744771033525, -0.068953737616539, -0.02745080180466175, -0.16511836647987366, 0.040311992168426514, -0.008167043328285217, 0.02181023545563221, -0.019904186949133873, -0.011166427284479141, 0.021303929388523102, 0.05033630505204201, 0.0001338688307441771, -0.09240119159221649, 0.015065396204590797, 0.06360487639904022, 0.00907677598297596, 0.06554578244686127, 0.00023461390810552984, -0.031676262617111206, -0.06914527714252472, -0.03428694233298302, -0.05178609862923622, 0.019035812467336655, 0.01663176715373993, -0.016485441476106644, -0.0072271497920155525, 0.0039388155564665794, -0.04124568775296211, -0.013674728572368622, -0.005020585842430592, 0.05740318447351456, 0.09707742929458618, -0.01644022949039936, -0.03454769030213356, -0.02837129682302475, 0.011008420027792454, -0.14403055608272552, 0.10524623841047287, 0.021004173904657364, -0.037941914051771164, 0.007978052832186222, -0.01676851697266102, -0.013750660233199596, 0.02421860210597515, -0.06486808508634567, -0.02317841351032257, -0.03519127145409584, 0.08680588752031326, 0.022792967036366463, -0.0985151156783104, 0.015431706793606281, 0.01665738970041275, 0.005942068062722683, 0.0002955831296276301, -0.0748014822602272, -0.041237201541662216, 0.012118084356188774, 0.01178386528044939, -0.01661553420126438, -0.004646094981580973, 0.003775092540308833, 0.02732275426387787, -0.014523833058774471, -0.009082887321710587, -0.04045135900378227, -0.0791955217719078, 0.033530689775943756, 0.02031739242374897, -0.025954537093639374, 0.006690732669085264, 0.04568135365843773, 0.029225721955299377, 0.010271233506500721, 0.38749960064888, -0.058414772152900696, -0.021510444581508636, -0.02616484835743904, -0.05071338638663292, -0.015117065981030464, -0.009835447184741497, 0.015425456687808037, 0.049042344093322754, 0.03158026933670044, 0.012111873365938663, 0.015767235308885574, -0.0016304475720971823, 0.06769068539142609, -0.0684252381324768, -0.001246540923602879, 0.006401047110557556, 0.010354997590184212, 0.007465285714715719, 0.0014455333584919572, 0.03191889449954033, 0.02826906554400921, -0.05507780611515045, -0.03512769564986229, 0.00023731403052806854, 0.06098278611898422, 0.0008981233113445342, 0.05240492895245552, 0.06584164500236511, 0.01149685401469469, 0.0042616985738277435, 0.03355609253048897, -0.04724638909101486, -0.015846317633986473, -0.0061603025533258915, 0.006565568037331104, 0.07216644287109375, 0.0012557654408738017, 0.015175964683294296, 0.060052692890167236, -0.06627576053142548, 0.009025992825627327, -0.02040141448378563, 0.06703207641839981, 0.0009749999735504389, -0.029589597135782242, 0.09664871543645859, -0.002407803200185299, 0.01763242483139038, 0.00990706030279398, -0.009030723944306374, -0.04543369635939598, 0.045860301703214645, -0.02045883797109127, -0.05314306169748306, -0.007759826257824898, 0.0029748210217803717, 0.018972160294651985, -0.01546319480985403, -0.047855254262685776, -0.01140193734318018, -0.0495491586625576, 0.00384141830727458, -0.006254193838685751, 0.0672992542386055, 0.03223438188433647, -0.022255700081586838, -0.03079248033463955, 0.02057231031358242, 0.03302668780088425, -0.04133767634630203, 0.015410419553518295, -0.042401332408189774, 0.055362485349178314, -0.05577130243182182, 0.019366838037967682, -0.022665593773126602, -0.015291828662157059, 0.07964231818914413, 0.05504211410880089, 0.01797085627913475, -0.01761157624423504, -0.012882235459983349, 0.005486558191478252, -0.007649309933185577, 0.003995235078036785, -0.07246538996696472, -0.0840362012386322, 0.009908659383654594, -0.012512924149632454, 0.06689990311861038, 0.03741709887981415, -0.0010521579533815384, -0.01625046879053116, -0.027228953316807747, -0.023606687784194946, -0.04142753779888153, 0.04340604692697525, 0.004572873469442129, -0.024579111486673355, -0.00919271819293499, 0.0626797080039978, 0.028939904645085335, -0.008556845597922802, 0.04901048168540001, -0.05032525584101677, -0.06961145997047424, 0.03591125085949898, -0.0240761861205101, 0.060336604714393616, -0.02041058987379074, -0.05817102640867233, -0.020122315734624863, -0.03927316889166832, -0.013777541927993298, -0.04860105365514755, 0.0170441884547472, 0.0019404039485380054, -0.03012939542531967, 0.027532687410712242, -0.0011831710580736399, -0.0699622705578804, -0.1036185771226883, -0.006879313848912716, -0.343643456697464, -0.008214214816689491, 0.04127048701047897, -0.044802334159612656, 0.05768546089529991, -0.07442011684179306, 0.054305631667375565, 0.0033400950487703085, 0.03005841374397278, -0.016779152676463127, 0.08241269737482071, -0.111447773873806, 0.0008483115234412253, -0.04955438897013664, 0.018212446942925453, 0.025417422875761986, -0.014684823341667652, -0.02228647656738758, -0.01607753336429596, -0.006014378275722265, -0.02162884548306465, -0.02675725519657135, -0.03195058926939964, -0.07198251038789749, 0.04481709003448486, 0.04118555411696434, 0.06808119267225266, 0.01836637780070305, 0.09729523956775665, 0.0015681660734117031, 0.12449082732200623, -0.009340723976492882, -0.05204883590340614, -0.11588851362466812, -0.005447829607874155, 0.02606881782412529, -0.012382990680634975, -0.008548775687813759, 0.0012878888519480824, 0.017220869660377502, -0.03927433490753174, -0.02731063775718212, 0.03728049620985985, 0.015386941842734814, 0.02799844928085804, -0.02961781434714794, 0.016417687758803368, 0.01860981434583664, -0.005434642545878887, -0.018421947956085205, 0.019092939794063568, 0.021428372710943222, -0.03838424012064934, -0.030187740921974182, 0.01757754012942314, -0.06023930385708809, 0.01244262419641018, -0.025326019152998924, 0.018226778134703636, -0.02218492142856121, 0.02222977578639984, 0.012398120947182178, 0.017878035083413124, 0.02393384836614132, 0.02641388028860092, -0.040379490703344345, -0.03997451812028885, -0.0021770703606307507, -0.006564693059772253, -0.025774886831641197, -0.0335221029818058, 0.04461104795336723, -0.023103540763258934, 0.03404232859611511, 0.10101618617773056, -0.021691424772143364, -0.01709318719804287, 0.04991534724831581, -0.024187296628952026, -0.04329882562160492, 0.0012220923090353608, 0.002718487288802862, 0.05862932652235031, 0.07433373481035233, 0.013805580325424671, -0.011336651630699635, 0.06452839076519012, -0.0058498689904809, 0.03402199223637581, -0.06035226583480835, -0.028586333617568016, -0.04793231561779976, -0.025148313492536545, 0.012197142466902733, 0.013855489902198315, 0.005252200178802013, -0.26539433002471924, 0.034769054502248764, -0.015330319292843342, 0.005836181342601776, -0.0015277478378266096, -0.0004974054172635078, 0.013474643230438232, -0.024607446044683456, 0.00612484710291028, 0.007612132932990789, 0.030264412984251976, 0.051033440977334976, -0.005651458632200956, -0.004727816674858332, -0.0027500202413648367, 0.03496256470680237, 0.10602404922246933, 0.026106826961040497, 0.029449785128235817, -0.002903952728956938, 0.013020262122154236, -0.0018995970021933317, 0.1665145307779312, -0.03546065092086792, 0.047487419098615646, 0.004284929484128952, 0.021983934566378593, 0.0176985040307045, 0.07162806391716003, 0.021740732714533806, 0.019635625183582306, 0.011865460313856602, 0.05426504462957382, -0.0495619922876358, 0.01371041126549244, -0.013022925704717636, 0.0019256003433838487, 0.062016330659389496, -0.013058490119874477, -0.009506703354418278, -0.05754243955016136, -0.005002572666853666, 0.004784943535923958, -0.017964206635951996, 0.027608508244156837, -0.021374141797423363, 0.0012524864869192243, -0.033435069024562836, -0.04749596118927002, 0.04077843949198723, 0.005534644238650799, 0.04008513316512108, 0.012027892284095287, -0.012117112055420876, 0.021488822996616364, 0.013113833963871002, 0.04263278841972351, 0.015986671671271324, 0.012349609285593033, 0.051069047302007675, 0.04900005832314491, 0.02210034616291523, 0.13467633724212646, 0.06352219730615616, 0.055856842547655106]\n",
      "[-0.032679956406354904, -0.03315657377243042, -0.02493159845471382, -0.027276145294308662, 0.04104030504822731, -0.02652779035270214, -0.040819328278303146, -0.013783481903374195, -0.007910813204944134, -0.030446259304881096, 0.08054812252521515, 0.0024990958627313375, -0.031139880418777466, -0.05248439684510231, 0.009044332429766655, -0.018295733258128166, 0.0024067594204097986, -0.0009296837379224598, -0.012969916686415672, 0.009617391973733902, 0.036895737051963806, -0.008468023501336575, -0.0005141303408890963, -0.05139227956533432, 0.025001412257552147, 0.10608909279108047, 0.021154308691620827, -0.05550262704491615, -0.059894148260354996, -0.17254771292209625, 0.025740990415215492, -0.01751849614083767, 0.07285378873348236, -0.014446762390434742, 0.023059453815221786, 0.0300984475761652, 0.03669370710849762, 0.0367666594684124, -0.059284042567014694, 0.003416662570089102, 0.012734795920550823, -0.012550302781164646, 0.04459012672305107, 0.02560853213071823, -0.02819526381790638, -0.0450252890586853, -0.026224544271826744, -0.03657374158501625, 0.028199471533298492, -0.0015758156077936292, -0.013093595393002033, 0.01428973488509655, 0.010826907120645046, -0.026683365926146507, -0.015000682324171066, 0.006874625571072102, 0.07189320027828217, 0.08005975931882858, -0.01739679090678692, -0.030823469161987305, -0.0034230430610477924, -0.006044106092303991, -0.12266585975885391, 0.06841271370649338, 0.037795353680849075, 0.003164147026836872, 0.017152855172753334, -0.03397795557975769, -0.05857592448592186, 0.018344920128583908, -0.11633660644292831, -0.023800864815711975, -0.056246623396873474, 0.11398735642433167, -0.007460901513695717, -0.1325133591890335, 0.02589542232453823, 0.0019331390503793955, 0.01286727748811245, 0.0006400665733963251, -0.04926286265254021, -0.03140144422650337, -0.029467761516571045, -0.006625866051763296, -0.004256898537278175, 0.011844072490930557, -0.005992672871798277, 0.031978704035282135, -0.025234034284949303, 0.001660864450968802, -0.02610977739095688, -0.08273682743310928, 0.03289983049035072, 0.03126579523086548, -0.034085992723703384, -0.05840257555246353, 0.0008092742064036429, 0.04943763092160225, 0.04471790790557861, 0.37050577998161316, -0.059122130274772644, 0.005172734148800373, -0.05222621560096741, -0.023252682760357857, -0.015324952080845833, 0.008699232712388039, 0.019605912268161774, 0.07417526841163635, 0.03843490779399872, 0.04751881584525108, 0.05074502155184746, 0.00348600372672081, 0.05566726252436638, -0.056845393031835556, 0.015874603763222694, -0.03624806925654411, -0.03507667034864426, 0.013607420027256012, -0.04537944495677948, 0.007749812211841345, 0.015155641362071037, -0.0737093985080719, 0.013260914944112301, -0.014966507442295551, 0.055213697254657745, -0.010847377590835094, 0.03858157992362976, 0.005178220570087433, 0.03396355360746384, 0.017218582332134247, 0.05119369179010391, -0.08838566392660141, -0.07749370485544205, -0.040600161999464035, 0.005577703006565571, 0.08080124109983444, -0.020104745402932167, 0.0060674152337014675, 0.03811296075582504, -0.05986538529396057, 0.019427061080932617, -0.01746513321995735, 0.02973962016403675, 0.0147666921839118, -0.053781282156705856, 0.06812477111816406, -0.06821563839912415, -0.03110538423061371, 0.030540844425559044, -0.002599698957055807, 0.020986445248126984, 0.013811224140226841, -0.018361158668994904, -0.04051993414759636, -0.04281856119632721, 0.024510186165571213, 0.029066473245620728, -0.005941533483564854, -0.02756509929895401, -0.03587713837623596, -0.05154893547296524, -0.03100132942199707, -0.03290684148669243, 0.07664007693529129, 0.020106421783566475, -0.028419988229870796, -0.04145361855626106, 0.0254860520362854, 0.021708330139517784, -0.06319531798362732, 0.00838130246847868, -0.07740487903356552, 0.050695013254880905, -0.05626685917377472, -0.004073331132531166, -0.05556213855743408, -0.01967642456293106, 0.02098722569644451, -0.009258066304028034, -0.010001931339502335, 0.023163875564932823, 0.0026974682696163654, -0.0018459904240444303, -0.020258253440260887, -0.0027648299001157284, -0.03633954003453255, -0.08486436307430267, -0.004403544124215841, -0.0071344454772770405, 0.042658764868974686, 0.013866342604160309, -0.002826179377734661, 0.012045824900269508, -0.07696277648210526, -0.00473650312051177, -0.009051447734236717, 0.08810403198003769, 0.040994152426719666, -0.015133439563214779, 0.0013030479894950986, 0.06440754234790802, 0.014526362530887127, 0.004015923012048006, 0.05309322476387024, -0.11019884794950485, -0.02405557967722416, -9.740348104969598e-06, -0.011244723573327065, -0.003348111640661955, -0.019379552453756332, -0.054661549627780914, -0.033722639083862305, -0.004664781037718058, -0.042742080986499786, -0.06226841360330582, -0.04918556287884712, -0.03567196801304817, 0.00011960591655224562, 0.014890437014400959, 0.05822613090276718, -0.048538438975811005, -0.0830141082406044, -0.031913649290800095, -0.28144025802612305, -0.03140880540013313, 0.012165839783847332, 0.02124032936990261, 0.06632868200540543, -0.045630235224962234, 0.012197595089673996, 0.023912329226732254, -0.011662155389785767, -0.006287821568548679, 0.05716020241379738, -0.08862681686878204, 0.030137531459331512, -0.0226058978587389, -0.0037268344312906265, 0.06046309694647789, 0.031452860683202744, -0.04103117063641548, -0.02195340022444725, 0.07477618008852005, 0.04418055713176727, -0.03756312280893326, -0.04891851916909218, -0.028571471571922302, 0.024498676881194115, 0.07150082290172577, 0.08443174511194229, 0.021369246765971184, 0.1249346137046814, 0.008684688247740269, 0.054710064083337784, 0.014632105827331543, -0.04463966190814972, -0.08632533252239227, -0.044474415481090546, -0.006153492722660303, -0.00492802495136857, -0.03848690167069435, 0.04250026494264603, 0.016377929598093033, -0.07473857700824738, -0.023599861189723015, -0.0305231474339962, 0.0459396094083786, 0.020775239914655685, -0.05154762789607048, -0.0009703448740765452, -0.019738325849175453, 0.01360868290066719, -0.010452681221067905, 0.009395263157784939, 0.03188561648130417, 0.02301327884197235, -0.023423533886671066, 0.023582082241773605, -0.02853519655764103, 0.035128653049468994, -0.047952570021152496, -0.004584397189319134, -0.03379937261343002, 0.06225339695811272, 0.05325455218553543, 0.03612755984067917, 0.024724440649151802, 0.013136097230017185, -0.014567911624908447, -0.041411273181438446, 0.06365891546010971, 0.03545989468693733, -0.004266803152859211, -0.0013457563472911716, 0.057652465999126434, -0.03183630853891373, -7.429450488416478e-05, 0.08281122148036957, 0.0055732084438204765, -0.0051910048350691795, -0.0120770875364542, -0.03356596454977989, -0.030515018850564957, 0.014001311734318733, -0.02408772148191929, 0.07859078794717789, 0.03292810171842575, 0.019386233761906624, -0.009719089604914188, 0.07901836186647415, 0.006568984594196081, 0.01587924361228943, -0.06777195632457733, -0.029196690768003464, -0.03336120769381523, -0.02451283298432827, -0.0025379161816090345, 0.02690490335226059, 0.04197469726204872, -0.23886264860630035, 0.023762227967381477, 0.03299394249916077, 0.03318782150745392, 0.004599175415933132, -0.0676538348197937, 0.0563344769179821, -0.01366403792053461, 0.013689613901078701, 0.04879812151193619, 0.06834018230438232, 0.06062119081616402, -0.0015033404342830181, -0.03583165630698204, -0.015805672854185104, 0.03546274080872536, 0.09993315488100052, 0.02512340061366558, -0.005353029817342758, 0.023222995921969414, 0.030012521892786026, 0.0020043151453137398, 0.14502784609794617, -0.05016074702143669, 0.016173934563994408, -0.017807865515351295, -0.026171455159783363, -0.024932801723480225, 0.0533670149743557, 0.022739633917808533, 0.07228721678256989, 0.007800496648997068, 0.041439395397901535, -0.051520850509405136, 0.07989846915006638, -0.007865088991820812, 0.04088863730430603, 0.10847759991884232, 0.04945706948637962, -0.03785926103591919, -0.04349588602781296, 0.007914027199149132, -0.051478128880262375, -0.03433992713689804, 0.026555946096777916, -0.00872782338410616, -0.001485164393670857, -0.027284223586320877, -0.0018271348671987653, 0.03334609046578407, 0.020900798961520195, -0.0022130326833575964, 0.02916867472231388, 0.0008173744427040219, 0.039533764123916626, 0.0438581258058548, -0.009530856274068356, 0.0020848442800343037, -0.026434529572725296, -0.02776549756526947, 0.06424444168806076, 0.03636792302131653, 0.14227408170700073, 0.0600900799036026, 0.06545811146497726]\n",
      "[-0.02331225387752056, -0.028134314343333244, 0.010231181979179382, -0.028058163821697235, 0.02060876600444317, -0.05067230015993118, -0.04336109757423401, 0.0018121765460819006, -0.05228149890899658, -0.02915576659142971, 0.09124349802732468, 0.011381118558347225, -0.013994306325912476, -0.05375589430332184, 0.011709462851285934, 0.00616928655654192, 0.0022326705511659384, 0.04031604528427124, -8.274024003185332e-05, -0.02222515270113945, 0.0035378525499254465, 0.0030438369140028954, -0.0033307024277746677, -0.0339924693107605, 0.023545492440462112, 0.09699838608503342, 0.00795110035687685, -0.07886134833097458, -0.07452642172574997, -0.1591341644525528, 0.04215528443455696, 0.013944967649877071, 0.01656285859644413, 0.024756774306297302, 0.009372175671160221, 0.001433194032870233, 0.019574107602238655, 0.009091811254620552, -0.04539022594690323, -0.0010508683044463396, 0.03149257227778435, 0.030524257570505142, 0.054498329758644104, -0.011882847175002098, -0.0031761429272592068, -0.053759533911943436, -0.015291898511350155, -0.028657641261816025, 0.05182415246963501, 0.013174808584153652, 0.009840177372097969, 0.03981686383485794, 0.007866805419325829, -0.004100948106497526, -0.03575434535741806, 0.004154406022280455, 0.06451916694641113, 0.06384553015232086, -0.0030366675928235054, -0.0061893463134765625, 0.009120350703597069, -0.02047700434923172, -0.1304829716682434, 0.05088872089982033, 0.04393577203154564, -0.014788349159061909, 0.01803962141275406, -0.029991110786795616, -0.034288592636585236, 0.050527073442935944, -0.12012194842100143, -0.01793432980775833, -0.06690526008605957, 0.10102323442697525, 0.005974261090159416, -0.09648140519857407, 0.021566089242696762, -0.020805632695555687, 0.033462878316640854, -0.027641452848911285, -0.03494998812675476, -0.0339697040617466, -0.032672058790922165, 0.010075096972286701, -0.03449792042374611, -0.034185152500867844, 0.02545943111181259, 0.04209601506590843, -0.017040178179740906, 0.005697503685951233, -0.012906528078019619, -0.08819320797920227, 0.0686659961938858, 0.02659151516854763, -0.02765914797782898, -0.022516850382089615, 0.008580920286476612, 0.050800621509552, 0.03596290200948715, 0.3776427209377289, -0.07014436274766922, 0.02207482047379017, -0.05336225777864456, -0.03170601651072502, -0.01718754693865776, 0.025386955589056015, 0.0084134666249156, 0.07216797769069672, 0.039441365748643875, 0.05901870131492615, 0.0365256629884243, 0.012546837329864502, 0.012425420805811882, -0.07139902561903, 0.04131375253200531, -0.04379957169294357, -0.028998149558901787, 0.017504174262285233, -0.0259314626455307, 0.0022559526842087507, 0.011342378333210945, -0.04203273728489876, 0.02650154009461403, -0.022897500544786453, 0.033994514495134354, 0.009190013632178307, 0.023160472512245178, 0.01101874839514494, 0.058409981429576874, 0.037049781531095505, 0.029068661853671074, -0.12281094491481781, -0.07341169565916061, -0.019707484170794487, 0.005753588862717152, 0.06836897879838943, -0.012930392287671566, -0.034267205744981766, 0.011479496024549007, -0.046868469566106796, 0.0412147082388401, -0.031864725053310394, 0.01284070871770382, 0.040552910417318344, -0.014895993284881115, 0.05782090499997139, -0.05407172068953514, -0.010105638764798641, 0.03563743457198143, -0.01368512399494648, -0.007449856027960777, -0.002112605143338442, -0.035596370697021484, -0.0521569661796093, -0.009570171125233173, 0.007212799042463303, -0.016974275931715965, -0.021963803097605705, -0.006643293891102076, -0.029636142775416374, -0.07348688691854477, -0.012274491600692272, -0.03567077964544296, 0.044635921716690063, 0.024905145168304443, -0.03980083018541336, -0.04102912172675133, 0.025443127378821373, 0.042463988065719604, -0.05013669282197952, 0.016342950984835625, -0.07960592955350876, 0.017880059778690338, -0.0545247457921505, 0.03332385793328285, -0.010672775097191334, -0.04457908868789673, 0.03241928666830063, 0.025448348373174667, 0.024599481374025345, 0.043180495500564575, -0.029184773564338684, -0.001565435086376965, -0.0027294906321913004, -0.001595628447830677, -0.01829369366168976, -0.06021583825349808, 0.013626362197101116, -0.003317425027489662, 0.04924309626221657, -0.02235095389187336, -0.02626791223883629, -0.0020967568270862103, -0.07568219304084778, 0.017233092337846756, -0.024484440684318542, 0.08180902898311615, 0.02983596734702587, -0.01717454008758068, 0.01382862962782383, 0.06213997304439545, -0.010350747033953667, 0.004975640214979649, 0.055592212826013565, -0.12081218510866165, -0.018099289387464523, 0.037128057330846786, -0.05955628305673599, 0.02114151418209076, -0.030593933537602425, -0.04841272532939911, -0.030652526766061783, 0.03228544443845749, -0.02987651340663433, -0.05077993869781494, -0.04052746668457985, -0.03745273873209953, -0.007463035639375448, 0.015362457372248173, 0.0380827859044075, -0.09465915709733963, -0.06509838998317719, -0.02247977815568447, -0.28126537799835205, -0.014188474975526333, 0.012856028974056244, -0.02046237885951996, 0.06834931671619415, -0.08578785508871078, 0.009899676777422428, 0.019146721810102463, -0.04194635897874832, -0.02535500004887581, 0.07636351138353348, -0.1194375529885292, 0.016805270686745644, -0.02349580079317093, -0.013370717875659466, 0.06624393910169601, 0.019108831882476807, -0.048444125801324844, -0.020552681758999825, 0.025782756507396698, 0.024319099262356758, -0.04438234120607376, -0.023853417485952377, -0.04843982681632042, 0.0534290075302124, 0.06154460832476616, 0.11609167605638504, -0.001951913465745747, 0.14635983109474182, -0.02513149566948414, 0.06188531219959259, 0.031128080561757088, -0.04891796410083771, -0.11440935730934143, -0.057344939559698105, 0.0005898232338950038, -0.00525449076667428, -0.03297928720712662, 0.041812825947999954, -0.011120776645839214, -0.05339089408516884, -0.027150433510541916, -0.010836053639650345, 0.03326093405485153, -0.008883900009095669, -0.028686027973890305, -0.019542444497346878, -0.0009956889552995563, 0.03674715757369995, -0.0081565473228693, -0.010568732395768166, 0.007348767947405577, 0.014758776873350143, -0.004578478168696165, 0.012376234866678715, -0.05125400051474571, 0.05127030611038208, -0.03783861920237541, -0.003264772705733776, -0.008646569214761257, 0.04726215824484825, 0.04774363711476326, 0.012881371192634106, 0.004562164191156626, -0.009829086251556873, -0.016357798129320145, -0.03871778026223183, 0.050303518772125244, 0.03365868330001831, -0.0016483744839206338, -0.024404626339673996, 0.027808349579572678, -0.02854933962225914, 0.013556019403040409, 0.069453664124012, 0.011444293893873692, 0.005414095241576433, 0.0486551932990551, -0.0027976175770163536, -0.05210096761584282, 0.007584049832075834, -0.03586053103208542, 0.08905144780874252, 0.041270285844802856, 0.022463327273726463, 0.0016393581172451377, 0.04949164390563965, 0.03783741965889931, 0.03477781265974045, -0.0039193532429635525, -0.06948390603065491, -0.034658707678318024, -0.04090108349919319, -0.005801593419164419, 0.02222919836640358, 0.03847774490714073, -0.22521048784255981, 0.022594869136810303, 0.03678665682673454, 0.03067047894001007, -0.007727612741291523, -0.02254326641559601, 0.07896905392408371, 0.0014553193468600512, 0.025365762412548065, 0.039497531950473785, 0.06420917063951492, 0.05686289444565773, 0.020528700202703476, -0.0059651839546859264, 0.020230770111083984, -0.014523194171488285, 0.07929246872663498, 0.052028968930244446, 0.027890775352716446, -0.010442695580422878, 0.013942785561084747, 0.004462208598852158, 0.16677817702293396, 0.007576792035251856, 0.03629697486758232, 0.0007148864679038525, -0.0142051475122571, -0.036645710468292236, 0.026244288310408592, 0.03186836838722229, 0.051303423941135406, 0.028200704604387283, 0.03175240010023117, -0.07018273323774338, 0.051216114312410355, -0.06546097248792648, 0.00024039291020017117, 0.07400710880756378, 0.03980398550629616, -0.02769208326935768, -0.06391347199678421, 0.000950413930695504, -0.07598146051168442, 0.009033388458192348, 0.07066023349761963, -0.03152478486299515, 0.0064982217736542225, -0.037642866373062134, -0.03474671393632889, 0.04748697206377983, 0.016677169129252434, 0.01243912149220705, 0.037985146045684814, -0.0155061986297369, 0.011868610978126526, 0.060527607798576355, -0.009455216117203236, -0.012435302138328552, -0.016269298270344734, -0.009303429163992405, 0.08298635482788086, 0.037979841232299805, 0.12983153760433197, 0.02656816691160202, 0.054405998438596725]\n",
      "[-0.03946227580308914, -0.03252945467829704, 0.007396823260933161, -0.04999507591128349, 0.012032476253807545, -0.019817087799310684, 0.02199172042310238, 0.014413207769393921, 0.02106665074825287, -0.013092389330267906, 0.05596709996461868, 0.03360651433467865, -0.007171264383941889, -0.019879229366779327, -0.00037784542655572295, -0.03337908536195755, 0.03904802352190018, -0.011582259088754654, 0.032150983810424805, 0.00029524785350076854, 0.04990622028708458, -0.016507089138031006, -0.00570708280429244, -0.04426313936710358, 0.022098148241639137, 0.09471145272254944, -0.00805208645761013, -0.0056780423037707806, -0.056079257279634476, -0.21759521961212158, 0.057536493986845016, -0.003660061163827777, 0.010392875410616398, 0.0023624266032129526, -0.048319004476070404, 0.013033168390393257, -0.005800482351332903, 0.06010576710104942, -0.01632852852344513, -0.011745583266019821, 0.0063064685091376305, 0.02170553244650364, 0.04413941130042076, -0.011092377826571465, -0.046328846365213394, -0.045921094715595245, -0.03291568160057068, -0.03586145117878914, 0.02011762000620365, -0.0042943768203258514, 0.002504600677639246, 0.058307722210884094, 0.032644979655742645, -0.043063901364803314, -0.03214242309331894, 0.0027523518074303865, 0.05314462631940842, 0.07067127525806427, -0.07440914213657379, -0.0016867514932528138, -0.006888318341225386, -0.023320693522691727, -0.1493140161037445, 0.10322000086307526, 0.028767691925168037, -0.023318376392126083, 0.0060999090783298016, -0.008001902140676975, -0.028417440131306648, 0.07005240768194199, -0.04745354875922203, -0.026282276958227158, -0.08338560909032822, 0.07894032448530197, 0.028148943558335304, -0.08665560930967331, -0.014955167658627033, -0.01021695788949728, -0.005219503305852413, -0.057172805070877075, -0.05331938713788986, -0.03191995620727539, -0.05133073031902313, 0.011255946941673756, 0.017839983105659485, 0.003251313464716077, 0.018789980560541153, 0.00907198153436184, 0.004970139358192682, -0.025330685079097748, -0.02061261609196663, -0.0802663043141365, 0.029375925660133362, 0.050282154232263565, 0.015783313661813736, -0.022312995046377182, 0.005055555142462254, 0.01960267871618271, 0.01293256413191557, 0.42406195402145386, -0.047728706151247025, -0.03938867896795273, -0.025075998157262802, 0.0020570429041981697, -0.00566021166741848, -0.013970084488391876, 0.03288257122039795, 0.03737638145685196, -0.012744536623358727, 0.030715877190232277, 0.03672587871551514, -0.015612932853400707, 0.008882866241037846, -0.08590205758810043, 0.032184865325689316, -0.00917417835444212, -0.022789234295487404, -0.020025547593832016, -0.017574941739439964, 0.01970219612121582, -0.02832060120999813, -0.04995614290237427, 0.005408677738159895, -0.02875692769885063, 0.06039031594991684, -0.035083793103694916, 0.04479242116212845, 0.04515015333890915, 0.03911416232585907, 0.07096104323863983, 0.011389249935746193, -0.09252914786338806, -0.07935754954814911, -0.03131026029586792, 0.013475632295012474, -0.00015886861365288496, 0.004735060501843691, 0.023777365684509277, -0.002165973884984851, 0.011084741912782192, 0.0036854713689535856, -0.02539745345711708, 0.04689524695277214, 0.0015243442030623555, -0.00694497162476182, 0.09966366738080978, -0.06528086215257645, -0.0010077916085720062, 0.013260118663311005, -0.012981442734599113, -0.004691637586802244, 0.04930274561047554, -0.014619358815252781, -0.04280070587992668, -0.0388735868036747, -0.02638169378042221, 0.03207921236753464, 0.036265116184949875, -0.03187885135412216, 0.010388117283582687, -0.030094485729932785, -0.013857943005859852, -0.005139997694641352, 0.03659122809767723, -0.023771654814481735, -0.032371677458286285, -0.01871013082563877, 0.05664357915520668, -0.00026968741440214217, -0.06435949355363846, 0.00875886995345354, -0.04687006026506424, 0.03072539158165455, -0.03808194398880005, 0.03240082785487175, 0.012090612202882767, -0.03278354927897453, 0.036833565682172775, 0.0233448576182127, 0.008330941200256348, -0.007590105757117271, -0.017123622819781303, -0.05626668035984039, 0.015373186208307743, -0.016719920560717583, 0.021204520016908646, -0.07973039895296097, 0.005536909680813551, 0.0015539685264229774, 0.05990156903862953, 0.010082169435918331, -0.013578422367572784, -0.059093184769153595, -0.06608454138040543, -0.043881963938474655, -0.015457378700375557, 0.005119341425597668, -0.010439048521220684, -0.050960905849933624, 0.0010099983774125576, 0.06624306738376617, 0.07078930735588074, 0.04744648560881615, 0.04133981466293335, -0.03534020856022835, -0.0011016305070370436, 0.01290075946599245, -0.026223575696349144, 0.04921266436576843, -0.05950847640633583, -0.0481598898768425, 0.013314618729054928, -0.020610123872756958, -0.012482359074056149, -0.041873540729284286, -0.015805624425411224, 0.02883431687951088, -0.04858235642313957, 0.004884742666035891, 0.0019768131896853447, -0.05646685138344765, -0.0810493603348732, -0.02835961990058422, -0.30935725569725037, -0.02922445349395275, -0.029476212337613106, 0.04037351533770561, 0.016519712284207344, -0.11706411838531494, 0.03851867467164993, 0.050520654767751694, -0.007700320798903704, 0.02237796038389206, 0.11953939497470856, -0.04089290276169777, -0.017354771494865417, -0.083111472427845, 0.026000263169407845, 0.03019840456545353, -0.03798776865005493, -0.042895566672086716, -0.008563919924199581, 0.08328808844089508, -0.01605905033648014, -0.01456369273364544, 0.022342635318636894, -0.023556368425488472, 0.015959342941641808, 0.04973495006561279, 0.09407802671194077, -0.00015679090574849397, 0.04961136355996132, -0.008572949096560478, 0.022270310670137405, 0.014276244677603245, -0.001963200746104121, -0.046767350286245346, -0.022172711789608, 0.03134911507368088, -0.017170095816254616, 0.02953287959098816, 0.014147058129310608, 0.025639891624450684, -0.038299720734357834, -0.06281740963459015, -0.042391836643218994, -0.009192349389195442, 0.008202560245990753, -0.02936786785721779, 0.008099517785012722, -0.021873686462640762, 0.011756948195397854, -0.03235161677002907, 0.024991318583488464, 0.04404737800359726, -0.022908508777618408, -0.016071274876594543, 0.0262141190469265, -0.01387645211070776, 0.001274826587177813, -0.02935878001153469, 0.018281253054738045, -0.03729179874062538, 0.013065479695796967, 0.03470950201153755, 0.052399199455976486, -0.005571283865720034, -0.014763148501515388, -0.008693108335137367, -0.024942126125097275, 0.0025699655525386333, -0.00118906085845083, 0.0031798039563000202, -0.001938460161909461, 0.06686252355575562, -0.03763240575790405, 0.017947407439351082, 0.0511658601462841, -0.0021811379119753838, 0.03335460647940636, 0.045440640300512314, -0.002323419088497758, -0.02839239127933979, 0.0019349298672750592, -0.026789361611008644, 0.031200414523482323, 0.02824150025844574, 0.025454651564359665, 0.016613110899925232, 0.0659259706735611, 0.014113330282270908, 0.03695497661828995, 0.012286714278161526, -0.024720342829823494, -0.04173082113265991, 0.01771891862154007, -0.005686384160071611, 0.00649896077811718, -0.013207891024649143, -0.2689061760902405, -0.009759173728525639, -0.023863768205046654, 0.030869152396917343, 0.018943998962640762, 0.009031998924911022, 0.06426282227039337, -0.02094200812280178, -0.023718511685729027, 0.06361223757266998, 0.011475453153252602, 0.05699621140956879, -0.009838663041591644, -0.08596388250589371, 0.01797926239669323, 0.036044515669345856, 0.11282873898744583, 0.05083099380135536, -0.003058413043618202, 0.009498002007603645, 0.01743205636739731, -0.03141576051712036, 0.16408465802669525, 0.005747589282691479, 0.017656506970524788, -0.009578119032084942, 0.021053515374660492, -0.027876706793904305, 0.04391341656446457, 0.05178125947713852, 0.03352443873882294, -0.014697274193167686, 0.06382032483816147, -0.045873258262872696, 0.018271327018737793, 0.01890154369175434, -0.024497684091329575, 0.0510592944920063, 0.033723294734954834, 0.030076753348112106, -0.008713793940842152, -0.016039500012993813, -0.02408025786280632, -0.012706057168543339, 0.025804758071899414, -0.04294439032673836, 0.010030873119831085, -0.05504985526204109, -0.011570747010409832, 0.010651800781488419, -0.0043772985227406025, 0.03142251819372177, -0.049319490790367126, -0.04019302874803543, 0.045770689845085144, 0.025959860533475876, -0.030939601361751556, -0.0023632177617400885, 0.06078660115599632, 0.008082603104412556, 0.07256747037172318, 0.04069293662905693, 0.13261887431144714, 0.07992534339427948, 0.08262645453214645]\n",
      "[-0.03734147176146507, -0.045623622834682465, 0.009020970202982426, -0.04875179007649422, 0.01253587007522583, -0.058841291815042496, 0.057306405156850815, -0.037639763206243515, -0.01736505515873432, 0.0013098465278744698, 0.044855959713459015, 0.049447204917669296, -0.024744637310504913, -0.04754066839814186, -0.024051904678344727, -0.029357019811868668, -0.01984531804919243, -0.02523316815495491, -0.03509804606437683, 0.05363120883703232, 0.010888000018894672, 0.0016358369030058384, -0.009937423281371593, -0.03298220783472061, -0.019830958917737007, 0.05717761069536209, 0.037520572543144226, -0.05416977405548096, -0.10547982901334763, -0.13885338604450226, 0.004191639367491007, -0.011838502250611782, 0.024488074705004692, 0.013304605148732662, 0.03428300470113754, 0.0055101001635193825, 0.023413315415382385, 0.02351953461766243, -0.03841981664299965, 0.003672689199447632, 0.05354965850710869, 0.03518921881914139, 0.05076459050178528, 0.007303183898329735, -0.03068879246711731, -0.035283565521240234, -0.041919123381376266, -0.03835541382431984, 0.055607717484235764, 0.0028267649468034506, -0.03813204914331436, 0.009174437262117863, -0.0022579319775104523, -0.022431321442127228, -0.07196634262800217, -0.056413885205984116, 0.013357309624552727, 0.05550962686538696, -0.014017501845955849, -0.06368499249219894, 0.019664468243718147, 0.035534899681806564, -0.12902286648750305, 0.08176080137491226, -0.0008503894205205142, 0.005036146845668554, 0.024363484233617783, -0.02416742965579033, -0.016393646597862244, 0.002556400140747428, -0.02362721785902977, -0.021402476355433464, -0.08180585503578186, 0.05370062217116356, 0.023669356480240822, -0.08946201950311661, -0.007753345184028149, 0.0004411996924318373, -0.004303607624024153, -0.035065848380327225, -0.06565886735916138, -0.07981232553720474, 0.005597120150923729, 0.019506441429257393, -0.050235554575920105, -0.008970283903181553, 0.036192797124385834, 0.051303960382938385, -0.012674393132328987, 0.03866654261946678, -0.04089726135134697, -0.06384171545505524, 0.04829991236329079, 0.018440749496221542, -0.02071603387594223, -0.028283530846238136, 0.028847133740782738, 0.06840746849775314, -0.02905627153813839, 0.3715381920337677, -0.05155813694000244, 0.005017971154302359, -0.061933256685733795, -0.02947728894650936, -0.02983682043850422, 0.0544513538479805, 0.05298032611608505, 0.06626053154468536, 0.0697198435664177, 0.036212291568517685, 0.0142131969332695, -0.030505504459142685, 0.03463904559612274, -0.03657744452357292, 0.04024042189121246, 0.012002130039036274, 0.02657541073858738, 0.01919519528746605, -0.022131597623229027, -0.01533566601574421, -0.023635147139430046, -0.03960224613547325, -0.006421023514121771, 0.00554029643535614, 0.07041673362255096, -0.00900550652295351, 0.046555645763874054, 0.030163774266839027, 0.06540263444185257, 0.029630741104483604, -0.01386182103306055, -0.04137067124247551, -0.042452581226825714, -0.01802784390747547, 0.015844076871871948, 0.07425546646118164, -0.029559426009655, -0.0034752259962260723, 0.054498340934515, -0.08291526883840561, 0.05642911046743393, -0.0522492453455925, 0.0822393074631691, 0.011897966265678406, 0.008605810813605785, 0.057726383209228516, -0.02884705178439617, -0.005522690713405609, -0.028861893340945244, -0.01075346302241087, -0.00963111873716116, 0.04225048050284386, -0.044438041746616364, -0.07874295860528946, -0.04407275468111038, -0.00972649548202753, 0.023839611560106277, -0.03574622794985771, -0.04723300412297249, -0.02900480479001999, -0.024465741589665413, -0.009796790778636932, -0.028428776189684868, 0.06668620556592941, 0.017255544662475586, 0.022479020059108734, -0.04967378079891205, 0.06353864073753357, 0.020249519497156143, -0.06494889408349991, 0.04267505928874016, -0.0709066316485405, -0.012192144058644772, -0.044533878564834595, 0.01656312867999077, -0.03395425155758858, -0.03068624436855316, 0.05516704544425011, -0.02163292095065117, -0.002196966903284192, -0.005380074959248304, -0.0004904675879515707, 0.006555470637977123, -0.027684533968567848, -0.006657886318862438, -0.029807228595018387, -0.07103420048952103, -0.015273974277079105, 0.03944981470704079, 0.08223480731248856, 0.011962652206420898, 0.010333090089261532, -0.016908718273043633, -0.04565155506134033, -0.07748964428901672, -0.0036916795652359724, 0.05951840803027153, 0.03100004978477955, -0.0795881599187851, -0.028424076735973358, 0.04039660468697548, 0.04017700254917145, -0.03379417955875397, 0.10664920508861542, -0.04779462143778801, -0.041760578751564026, 0.0383845753967762, -0.008655180223286152, 0.02166934125125408, -0.01441599428653717, -0.07097893208265305, -0.006698996294289827, -0.054183948785066605, 0.017572686076164246, -0.08729624003171921, -0.03778459131717682, 0.00014422649110201746, 0.027018317952752113, 0.057301148772239685, -0.004187798127532005, -0.0036509607452899218, -0.05757196992635727, 0.004801733419299126, -0.3011205494403839, -0.031161531805992126, 0.016620853915810585, 0.004290343727916479, 0.027385693043470383, -0.07962724566459656, -0.00089531164849177, -0.0025904173962771893, -0.0643896535038948, -0.0021891153883188963, 0.09915561228990555, -0.07432623207569122, -0.02830258570611477, -0.022801745682954788, 0.02303394302725792, -0.006829768884927034, -0.01516667753458023, -0.06152178347110748, 0.02246778830885887, 0.0438220277428627, 0.0574825145304203, -0.03411220759153366, -0.012605853378772736, -0.03111143968999386, 0.022323867306113243, 0.06994848698377609, 0.08198826760053635, -0.018880020827054977, 0.13107357919216156, 0.015121628530323505, 0.0636003315448761, 0.043032437562942505, -0.058312904089689255, -0.14261789619922638, -0.04295763745903969, 0.0270523801445961, -0.067749984562397, 0.009979675523936749, 0.02930550090968609, 0.012446096166968346, -0.03146939352154732, -0.02765149064362049, -0.0038945116102695465, 0.013335393741726875, -0.004558387212455273, -0.03265246003866196, 0.0044926004484295845, 0.011488384567201138, -0.008179347962141037, -0.015267331153154373, 0.020419614389538765, 0.038328077644109726, -0.014022785238921642, 0.005240042693912983, -0.00830323901027441, -0.02964850328862667, 0.02583075501024723, 0.0026167656760662794, -0.0017529227770864964, 0.0407099612057209, 0.007704523392021656, 0.03550639748573303, 0.023140262812376022, -0.005617375019937754, -0.013663610443472862, -0.07259748131036758, -0.053017597645521164, 0.024955643340945244, 0.010643157176673412, -0.03627049922943115, -0.04561350867152214, 0.04249577224254608, 0.002756643807515502, 0.0023941113613545895, 0.0527142696082592, 0.006664988584816456, 0.006225650664418936, 0.024614345282316208, 0.04630504921078682, -0.04617384821176529, 0.03846784308552742, 0.0029579319525510073, 0.04939272999763489, 0.02807808481156826, 0.019521428272128105, 0.03064153902232647, 0.06158820539712906, -0.003988912329077721, -0.005099129863083363, 0.0021972835529595613, -0.05367353931069374, -0.04164509102702141, -0.05155785009264946, 0.009379358030855656, 0.02707800641655922, 0.017942611128091812, -0.22382798790931702, -0.014906087890267372, 0.011890270747244358, 0.01759614609181881, 0.010208917781710625, 0.025059128180146217, 0.043744269758462906, -0.02722492441534996, -0.018393386155366898, 0.07768647372722626, 0.09153781831264496, 0.03893045708537102, -0.06718254834413528, -0.01048915646970272, 0.023633964359760284, -0.005259823985397816, 0.09513381868600845, 0.06035424396395683, 0.031198175624012947, 0.00875245314091444, 0.022908972576260567, -0.003984169103205204, 0.18504956364631653, 0.012345906347036362, 0.017814144492149353, -0.008969324640929699, 0.045044612139463425, -0.005042740143835545, 0.006301058456301689, 0.03187552094459534, 0.04101903736591339, -0.046550169587135315, 0.04992758855223656, -0.05078086256980896, 0.027308106422424316, -0.01917167752981186, 0.00458275293931365, 0.09683772176504135, 0.07751119136810303, -0.014154457487165928, -0.05119723826646805, 0.005859179422259331, -0.0466737374663353, -0.015190878883004189, 0.06132024899125099, 0.005348258186131716, -0.02517939917743206, -0.05604834854602814, -0.027611376717686653, 0.05695217475295067, 0.04570576921105385, 0.01032260712236166, -0.010263381525874138, 0.022172514349222183, 0.038467150181531906, 0.005990194156765938, 0.027396341785788536, -0.007994209416210651, 0.013297800906002522, 0.028630083426833153, 0.05996391549706459, 0.01363061461597681, 0.12982256710529327, 0.07926065474748611, 0.03382698819041252]\n",
      "[-0.015446323901414871, -0.01383239310234785, 0.016507575288414955, -0.030527358874678612, 0.03243519738316536, -0.09389201551675797, -0.017906609922647476, -0.013757276348769665, 0.020110884681344032, -0.012007092125713825, 0.059114713221788406, 0.03543608635663986, 0.06271253526210785, -0.00866335816681385, 0.039123937487602234, -0.052674975246191025, -0.009516186080873013, 0.046552952378988266, 0.030521279200911522, 0.02496638335287571, 0.002259657485410571, -0.021558720618486404, -0.010511445812880993, -0.014512523077428341, 0.022996963933110237, 0.052419375628232956, -0.0009081265889108181, -0.012943176552653313, -0.0700521394610405, -0.1807750165462494, 0.046532489359378815, -0.004114053212106228, -0.00041090906597673893, -0.04400813207030296, -0.026871871203184128, -0.01276489719748497, 0.006809702608734369, 0.011073359288275242, -0.032244011759757996, 0.0022222765255719423, 0.049780674278736115, 0.018697142601013184, 0.048617973923683167, 0.007770664989948273, 0.011497351340949535, -0.030130872502923012, -0.03860689699649811, -0.04868042469024658, 0.09192164987325668, 0.02887730300426483, -0.02420877106487751, 0.019198736175894737, 0.06272676587104797, -0.04876036196947098, -0.025629546493291855, -0.019026057794690132, 0.06763018667697906, 0.07052639871835709, -0.04728592559695244, 0.045989472419023514, -0.00595767330378294, -0.006603717338293791, -0.12796412408351898, 0.03690927475690842, 0.04764298349618912, -0.0026064917910844088, 0.010087819769978523, -0.026261677965521812, 0.018848709762096405, 0.060778308659791946, -0.08132360875606537, 0.009469146840274334, -0.05422955006361008, 0.07948922365903854, 0.0007856790907680988, -0.09902580827474594, -0.017837973311543465, -0.01933969184756279, 0.002632149262353778, -0.031780071556568146, -0.0648684874176979, -0.03439218923449516, -0.047138895839452744, -0.004131969064474106, 0.007021383848041296, 0.018275178968906403, -0.022087160497903824, 0.018876370042562485, -0.018835213035345078, -0.036930300295352936, -0.02841900661587715, -0.05917214974761009, 0.08946166932582855, 0.06053240969777107, -0.032985370606184006, -0.0019460666226223111, -0.00010769863001769409, 0.06900819391012192, 0.028278987854719162, 0.37712785601615906, -0.019577190279960632, -0.0029080824460834265, -0.0338975191116333, -0.05263780802488327, -0.005762540735304356, 0.021470654755830765, 0.05786244943737984, 0.08146067708730698, 0.045094817876815796, 0.027233818545937538, 0.028450747951865196, -0.018503660336136818, -0.0018856521928682923, -0.09790512174367905, 0.054959893226623535, 0.012272858992218971, 0.017173537984490395, 0.05641350895166397, -0.034364428371191025, -0.0010636000661179423, -0.038708850741386414, -0.058050986379384995, 0.007905381731688976, 0.002236834028735757, 0.05126245692372322, -0.013529747724533081, 0.024647386744618416, 0.024393677711486816, 0.04943465813994408, 0.06583164632320404, 0.006773154716938734, -0.05820668861269951, -0.0644097775220871, -0.028498107567429543, -0.01683706045150757, 0.058608680963516235, -0.038494739681482315, 0.01829926297068596, 0.014217082411050797, -0.06337939202785492, 0.049008794128894806, -0.012471312656998634, -0.010699407197535038, 0.015335229225456715, 0.011675940826535225, 0.06503238528966904, -0.0904541090130806, -0.03341270610690117, -0.019961606711149216, -0.004194146953523159, -0.021143190562725067, 0.013560779392719269, -0.02046285942196846, -0.08993107825517654, -0.008795307949185371, -0.03218645229935646, 0.034889448434114456, -0.026451148092746735, 0.015645263716578484, 0.0071343728341162205, -0.037199195474386215, -0.02872651256620884, -0.01133477408438921, 0.08010576665401459, -0.03828905150294304, -0.009921560063958168, -0.028923753648996353, 0.07231955975294113, -0.007549911737442017, -0.003588174469769001, -0.029312863945961, -0.06779833883047104, 0.06946461647748947, -0.058215122669935226, 0.050593405961990356, -0.028320077806711197, -0.020512625575065613, 0.017574455589056015, 0.030868414789438248, 0.03400840610265732, -0.010569794103503227, -0.024848271161317825, -0.00414844648912549, -0.011592633090913296, -0.033996980637311935, -0.020312871783971786, -0.06200214475393295, 0.005399723071604967, -0.003952387720346451, 0.059050802141427994, -0.01863081566989422, 0.002689797431230545, 0.0025096614845097065, -0.09098519384860992, -0.08205496519804001, -0.0030258148908615112, 0.00852405559271574, 0.002732735825702548, -0.035916753113269806, 0.020541507750749588, 0.0769616961479187, 0.025077402591705322, -4.44276120106224e-05, 0.013814572244882584, -0.13457933068275452, -0.030463144183158875, 0.03878096491098404, -0.03486577421426773, -0.0024248824920505285, 0.03252303972840309, -0.024084245786070824, -0.004979774821549654, -0.03453134372830391, -0.026649916544556618, -0.019791893661022186, -0.032347001135349274, 0.017144568264484406, -0.0034382774028927088, 0.022397814318537712, 0.011073825880885124, -0.06448037922382355, -0.039106469601392746, -0.010186915285885334, -0.30624571442604065, -0.047681186348199844, -0.008923551999032497, 0.01712280884385109, 0.06770230084657669, -0.12219103425741196, 0.03715062513947487, 0.0004963232204318047, -0.036064062267541885, 0.023394672200083733, 0.08829889446496964, -0.07577921450138092, -0.05141919478774071, -0.041690073907375336, 0.011417391709983349, 0.008568940684199333, 0.05564786493778229, -0.08314859867095947, -0.014818920753896236, -0.011598332785069942, 0.02978787198662758, -0.03134480118751526, 0.018103541806340218, -0.03485552966594696, 0.06813868135213852, 0.04373471811413765, 0.08436205983161926, -0.006361263804137707, 0.09152288734912872, 0.019115060567855835, 0.05994539335370064, 0.07632046937942505, -0.014253527857363224, -0.10504589229822159, -0.03828396275639534, 0.010065536014735699, 0.008948503993451595, -0.008446663618087769, 0.08069930970668793, 0.005497484467923641, -0.02268371917307377, -0.05392313748598099, -0.026328831911087036, 0.006915584672242403, -0.024936867877840996, -0.01381317712366581, -0.05633325129747391, 0.04501296579837799, 0.056550197303295135, 0.0238413717597723, -0.021310651674866676, 0.011196051724255085, -0.009743978269398212, -0.0264869537204504, 0.017658013850450516, -0.01178666204214096, -0.0027387633454054594, -0.037187609821558, 0.007723044604063034, -0.02806556411087513, -0.03181039169430733, 0.03580910339951515, 0.045957934111356735, -0.022859204560518265, 0.002739919349551201, 0.01165840681642294, -0.06277924031019211, 0.03746277838945389, 0.018381599336862564, -0.013816636055707932, -0.009843625128269196, 0.034252654761075974, -0.008961985819041729, -0.03738894686102867, 0.027715086936950684, 0.022629981860518456, -0.037524476647377014, 0.028520839288830757, -0.04956365004181862, -0.059287179261446, 0.028598245233297348, 0.002188637387007475, 0.03055403009057045, 0.09155780076980591, -0.01193033903837204, -0.019265515729784966, 0.023420073091983795, 0.015090273693203926, 0.015014712698757648, -0.02691471204161644, -0.028066882863640785, -0.06447714567184448, 0.00899610947817564, 0.04664039984345436, 0.01272556185722351, 0.039501696825027466, -0.23814526200294495, 0.0006809977348893881, 0.025105683133006096, 0.033539749681949615, 0.024613941088318825, 0.02535271644592285, 0.01971455104649067, -0.015033065341413021, 0.07474572211503983, 0.0658283680677414, 0.01158625353127718, 0.08789628744125366, 0.02563692070543766, -0.0541083887219429, 0.023108473047614098, 0.01972689852118492, 0.07160786539316177, 0.0481281578540802, 0.02799694985151291, 0.0228105578571558, 0.005630441941320896, -0.02523321844637394, 0.15311574935913086, 0.011724545620381832, -0.016591794788837433, -0.03023478575050831, 0.014027064666152, -0.056979089975357056, 0.04839160293340683, 0.038576945662498474, 0.06393801420927048, 0.03344306722283363, 0.020718693733215332, -0.04495785012841225, 0.007202743552625179, 0.04344770312309265, -0.01617450825870037, 0.04763108491897583, 0.03643789142370224, -0.03337187319993973, -0.029674774035811424, -0.0013407598016783595, -0.03374285623431206, -0.024211933836340904, 0.07871481031179428, -0.0532749742269516, 0.026108795776963234, -0.01757415570318699, -0.023571832105517387, 0.03572094440460205, 0.01351977325975895, 0.013740140944719315, -0.002164429286494851, 0.03676270693540573, 0.013043330051004887, 0.023400746285915375, -0.022202325984835625, -0.038841161876916885, -0.021057577803730965, -0.038322024047374725, 0.06499601900577545, -0.012109464965760708, 0.12488878518342972, 0.030523374676704407, 0.06886205822229385]\n",
      "[-0.04187699034810066, -0.015032274648547173, -0.02755719982087612, -0.04524416849017143, 0.005344320088624954, -0.045451924204826355, -0.010587810538709164, 0.021383363753557205, -0.00477524334564805, 0.013944115489721298, 0.03282417729496956, -0.007739104796200991, -0.02372630126774311, -0.005379493348300457, -0.01683591865003109, -0.045696403831243515, -0.01848793588578701, -0.03703147917985916, -0.02882334403693676, 0.029325537383556366, 0.057532407343387604, 0.036817796528339386, -0.004954226780682802, -0.005511005409061909, 0.04206475988030434, 0.04689307138323784, 0.005476753693073988, -0.009344051592051983, -0.0035168048925697803, -0.18352672457695007, -0.01901060715317726, -0.03980569541454315, -0.04530675336718559, -0.010584120638668537, -0.0013620943063870072, 0.0033741318620741367, 0.0024755606427788734, -0.041114989668130875, -0.05008067935705185, 0.03371470794081688, 0.03240235522389412, 0.012941474094986916, 0.0409732423722744, 0.015978757292032242, 0.03115420788526535, -0.028403503820300102, -0.0249088853597641, -0.051654890179634094, 0.06059170514345169, -0.004764388781040907, 0.0005447377916425467, 0.0014725247165188193, 0.02177422307431698, -0.047859981656074524, 0.010716273449361324, 0.034134507179260254, 0.11127914488315582, 0.05141935497522354, 0.00850910134613514, 0.0026358459144830704, -0.03690154477953911, 0.02153271622955799, -0.1386396735906601, 0.04342813417315483, 0.03967254236340523, -0.0392618402838707, -0.02489190734922886, 0.008412256836891174, -0.01512105856090784, 0.03448665887117386, -0.03311057388782501, -0.05807064101099968, -0.06982845067977905, 0.06562163680791855, 0.028932958841323853, -0.05941445007920265, 0.06174657121300697, 0.029341865330934525, 0.0098364083096385, -0.022765856236219406, -0.09685926884412766, -0.014522532932460308, -0.011741546913981438, -0.0064644287340343, 0.008925490081310272, -0.005930761806666851, -0.008168310858309269, 0.017297564074397087, -0.02295457385480404, -0.024665813893079758, -0.056870512664318085, -0.07573507726192474, 0.015373974107205868, 0.007445682771503925, -0.05442925915122032, -0.02131042070686817, 0.016411572694778442, 0.06550531834363937, 0.005613905377686024, 0.353926420211792, -0.042140740901231766, -0.004272850230336189, -0.037666015326976776, 0.0008386627305299044, 0.0151972072198987, -0.008498573675751686, 0.023829232901334763, 0.08562155067920685, 0.023033382371068, 0.005509141832590103, 0.0339120589196682, -0.02996109426021576, 0.01883450150489807, -0.06722301989793777, 0.02565043978393078, 0.005658145993947983, -0.012158066965639591, 0.030252724885940552, -0.02370539680123329, 0.04818315431475639, 0.00465759402140975, -0.008003654889762402, -0.04394244775176048, 0.025406114757061005, 0.0645650178194046, -0.010612967424094677, 0.03847059980034828, 0.034033164381980896, 0.008212193846702576, 0.035620834678411484, 0.043443966656923294, -0.02636917121708393, -0.040182460099458694, -0.00839489046484232, -0.04106716811656952, 0.0679607093334198, -0.0125390300527215, -0.014108323492109776, 0.010512275621294975, -0.09300272911787033, 0.01949263922870159, -0.0070527298375964165, -0.0005945003358647227, 0.018032291904091835, -0.012398993596434593, 0.07197332382202148, -0.028835354372859, 0.03720678761601448, 0.03316989168524742, -0.016544470563530922, 0.00457070441916585, 0.0157043244689703, -0.001893593929708004, -0.053352389484643936, -0.02878851629793644, -0.012368938885629177, -0.01740499585866928, 0.04228943958878517, -0.037861939519643784, 0.02443586103618145, -0.024152806028723717, -0.02839171327650547, -0.04494480416178703, 0.010435516014695168, 0.0022830350790172815, -0.034002918750047684, -0.0384250245988369, -0.014424105174839497, 0.015973001718521118, -0.028468292206525803, 0.02432541362941265, -0.062321361154317856, 0.04542173072695732, -0.043726444244384766, -0.0018736503552645445, 0.007449092343449593, -0.029076868668198586, 0.018323363736271858, 0.06532073020935059, 0.04497012123465538, 0.010945301502943039, -0.028296250849962234, -0.028160657733678818, -0.0008328904514200985, 0.022994056344032288, -0.010148877277970314, -0.10915063321590424, -0.0009057527640834451, -0.04223434627056122, 0.0604076012969017, 0.03560047224164009, 0.02909771353006363, -0.004252858925610781, -0.05630325898528099, -0.03848182037472725, -0.030684001743793488, 0.07410275191068649, 0.0480167530477047, -0.01711541973054409, -0.01434311829507351, 0.032042767852544785, 0.06453260034322739, -0.03211633116006851, 0.04232323542237282, -0.06775155663490295, -0.054299283772706985, 0.049597810953855515, -0.021139342337846756, 0.04315466061234474, -0.05647190287709236, -0.04783615469932556, -0.014818890020251274, -0.02737240493297577, -0.025573357939720154, -0.06671474128961563, -0.06152341887354851, -0.04221217706799507, 0.03027682565152645, 0.01623283512890339, 0.03184686601161957, -0.048080310225486755, -0.0908699557185173, 0.018373046070337296, -0.32178106904029846, -0.026878848671913147, 0.03626022860407829, -0.004769529215991497, 0.08397339284420013, -0.0962538942694664, 0.0305025614798069, 0.013219553045928478, 0.015222062356770039, -0.05528094619512558, 0.10087388008832932, -0.049405548721551895, -0.011169063858687878, -0.02077675238251686, 0.027902817353606224, 0.005488135851919651, 0.0030497454572468996, -0.03143966197967529, 0.012444205582141876, 0.05803465470671654, -0.0031499029137194157, -0.01648840680718422, -0.03944768011569977, -0.06067784130573273, 0.02502947300672531, 0.040240030735731125, 0.11356821656227112, 0.031735919415950775, 0.15083158016204834, -0.003485783701762557, 0.04098047688603401, 0.07135068625211716, -0.06663484871387482, -0.1012890413403511, -0.03100321814417839, 0.013120944611728191, -0.006211663130670786, 0.03153744339942932, -0.0078758979216218, 0.013771719299256802, -0.046556394547224045, -0.035587165504693985, 0.028229504823684692, 0.03466557338833809, 0.0499870739877224, -0.008420916274189949, -0.07054857164621353, -0.020326027646660805, 0.005221733823418617, 0.03923771530389786, 0.009766068309545517, 0.018584318459033966, -0.027521004900336266, 0.006906986236572266, 0.033338502049446106, -0.05472058057785034, 0.020617220550775528, -0.02547641471028328, 0.02692573331296444, -0.07877115905284882, 0.043494876474142075, 0.07582749426364899, 0.014618704095482826, 0.01642194390296936, -0.02605445124208927, 0.040757276117801666, -0.018349699676036835, 0.046129580587148666, 0.03501434996724129, -0.009343229234218597, -0.030250512063503265, 0.08357086777687073, 0.02025674097239971, 0.0054677799344062805, 0.05688178539276123, 0.023422375321388245, 0.002109895460307598, -0.0017497246153652668, 0.004840394016355276, -0.06215045973658562, 0.008384631015360355, -0.0057394839823246, 0.04852961748838425, 0.07085498422384262, -0.027304887771606445, 0.02119494415819645, 0.021595805883407593, 0.0013164563570171595, 0.06338391453027725, -0.0635918453335762, -0.011313071474432945, -0.027812262997031212, 0.0027627518866211176, -0.020025059580802917, 0.004232901614159346, 0.02007143944501877, -0.2787230610847473, 1.4026210919837467e-05, -0.000926696986425668, 0.010353874415159225, 0.001578314695507288, 0.018837066367268562, 0.019113676622509956, -0.05556831508874893, -0.02888363227248192, 0.02467931993305683, 0.024124793708324432, 0.06436501443386078, 0.00791178084909916, -0.03657263517379761, -0.0023416727781295776, 0.01705734245479107, 0.10305735468864441, 0.014658291824162006, 0.007825437933206558, -0.007575795520097017, -0.009679004549980164, -0.0268839281052351, 0.1857057809829712, -0.020928820595145226, 0.006232702638953924, -0.07985854148864746, -0.0429617241024971, -0.02519155666232109, 0.0654381737112999, 0.005263124126940966, 0.022274503484368324, 0.023309027776122093, 0.049919310957193375, -0.03560727462172508, 0.039275601506233215, -0.009171910583972931, 0.01994619332253933, 0.04316430538892746, 0.026186784729361534, -0.02727438323199749, -0.04123698174953461, 0.014362148940563202, -0.07039391994476318, -0.05415630340576172, 0.04482400417327881, -0.025966309010982513, 0.004188442137092352, -0.0021785381250083447, -0.01745346374809742, 0.03776918724179268, -0.028219014406204224, 0.030715031549334526, 0.026346402242779732, -0.02035391516983509, 0.022108836099505424, 0.04299554601311684, -0.026777274906635284, 0.010251478292047977, -0.017802491784095764, 0.0015409248881042004, 0.047601114958524704, 0.032423194497823715, 0.15968619287014008, 0.08576957881450653, 0.08854901790618896]\n",
      "[-0.018649274483323097, -0.0036299030762165785, -0.02023073472082615, -0.07022194564342499, 0.022487150505185127, -0.05883598327636719, -0.06410377472639084, 0.005368835758417845, -0.015450848266482353, -0.0014762167120352387, 0.02894415520131588, 0.0014955878723412752, 0.010588914155960083, -0.010154865682125092, -0.0029597992543131113, -0.07172568887472153, 0.04475869983434677, -0.00761212594807148, -0.038812100887298584, 0.05518496781587601, 0.05551793426275253, -0.005867225117981434, 0.017096862196922302, -0.018123172223567963, 0.015219087712466717, 0.037552982568740845, 0.020732764154672623, -0.03811560943722725, -0.028784938156604767, -0.2106064409017563, 0.018834762275218964, -0.044416602700948715, -0.04644709452986717, 0.01737634651362896, -0.03380412980914116, 0.009151158854365349, 0.025828594341874123, -0.01004880852997303, -0.02651968039572239, 0.008139251731336117, 0.050505880266427994, -0.00424428004771471, 0.014528123661875725, -0.013892276212573051, -0.008408436551690102, -0.056397657841444016, -0.06293350458145142, -0.041862454265356064, 0.035087283700704575, 0.014472555369138718, -0.06606270372867584, 0.031172016635537148, 0.045964814722537994, -0.0334896482527256, -0.022308481857180595, 0.004764311481267214, 0.04111383482813835, 0.09756731986999512, -0.022820204496383667, -0.006052244920283556, -0.019428446888923645, -0.004478056915104389, -0.14605633914470673, 0.10499288141727448, 0.05636867880821228, 0.03859629109501839, -0.03331095352768898, 0.012074809521436691, -0.01330743357539177, 0.02106425352394581, -0.017053203657269478, 0.0013535732869058847, -0.06187186390161514, 0.09535898268222809, 0.018947064876556396, 0.014072942547500134, 0.013786985538899899, 0.017153697088360786, 0.016285274177789688, 0.002044292166829109, -0.03455737978219986, -0.031907666474580765, -0.007437207270413637, 0.027224361896514893, -0.03319745138287544, -0.03427499160170555, -0.018170610070228577, -0.0004921879735775292, -0.019627703353762627, -0.042125143110752106, -0.023635586723685265, -0.0832129642367363, 0.031026972457766533, 0.028302187100052834, -0.04593737795948982, -0.041550617665052414, -0.01753435842692852, 0.04049504175782204, 0.05533793941140175, 0.37943002581596375, -0.041165124624967575, 0.042282868176698685, -0.03378835320472717, -0.02307693473994732, 0.040437374264001846, 0.040450047701597214, -0.003449699841439724, 0.05088895931839943, 0.0024049454368650913, -0.003996230661869049, 0.024430669844150543, -0.00012625832459889352, 0.004720946773886681, -0.049468353390693665, -0.0027788032311946154, -0.013167320750653744, -0.04901542887091637, -0.006693429779261351, -0.02774076722562313, 0.005327034275978804, -0.02057560160756111, -0.04292614758014679, -0.032787736505270004, 0.009595719166100025, 0.09491847455501556, -0.011822216212749481, 0.04103434830904007, 0.02781819738447666, 0.037371959537267685, 0.08828148245811462, 0.016641071066260338, -0.041156817227602005, -0.02369707264006138, -0.028389010578393936, -0.04480871185660362, 0.06256658583879471, 1.0990686405421002e-06, -0.022563891485333443, -0.03238990902900696, -0.018480321392416954, 0.009108337573707104, -0.03391339257359505, -7.258988625835627e-05, 0.033203188329935074, -0.012643762864172459, 0.1112542599439621, -0.04096907377243042, 0.009237056598067284, -0.04141761362552643, -0.055654626339673996, -0.02454199083149433, -0.009326512925326824, 0.02471759170293808, -0.03783852234482765, 0.004291743040084839, 0.020168835297226906, 0.03491547331213951, 0.05441848933696747, -0.0412711501121521, -0.005228277761489153, -0.04238424077630043, -0.009490616619586945, -0.00520730298012495, 0.023498039692640305, 0.025052445009350777, -0.03510962054133415, -0.006052019540220499, 0.030212726444005966, 0.02766638807952404, -0.03677414730191231, -0.026171425357460976, -0.05118023231625557, 0.014081990346312523, -0.056981444358825684, -0.001077166642062366, -0.04433469846844673, -0.053521815687417984, 0.03365154564380646, 0.043936587870121, 0.06409621238708496, 0.014145301654934883, -0.015252256765961647, -0.01709880121052265, 0.011934047564864159, -0.012716876342892647, -0.05530346930027008, -0.09603335708379745, 0.0027879311237484217, -0.01585603505373001, 0.09803102910518646, -0.04622012376785278, 0.01315646804869175, -0.02613765560090542, -0.03473973646759987, -0.007827780209481716, -0.07423491030931473, 0.007866737432777882, 0.030579200014472008, -0.07545111328363419, 0.027104012668132782, 0.07548287510871887, 0.030348939821124077, -0.01837518811225891, -0.03853804990649223, -0.08309662342071533, -0.04497208818793297, 0.035017866641283035, -0.049353428184986115, 0.0720672458410263, -0.010805143043398857, -0.03264178708195686, -0.014770161360502243, -0.009673073887825012, -0.03199724853038788, -0.051119495183229446, -0.018316438421607018, 0.0316668376326561, 0.038909610360860825, -0.0033939494751393795, 0.018386472016572952, -0.03527746722102165, -0.07957959920167923, 0.009574132040143013, -0.31060999631881714, -0.01939300447702408, 0.03203853964805603, -0.004714607261121273, 0.11713960021734238, -0.10136707872152328, -0.01649787649512291, 0.028580253943800926, -0.00805430207401514, 0.013135089538991451, 0.1010989397764206, -0.021668877452611923, -0.05087292566895485, -0.11100499331951141, -0.014623288065195084, 0.00910161156207323, 0.025101151317358017, -0.022836141288280487, 0.0065757110714912415, 0.07359237223863602, -0.002116477582603693, -0.04326669126749039, -0.03276444226503372, -0.06903048604726791, 0.023724231868982315, 0.01647329330444336, 0.11754123866558075, -0.013114397414028645, 0.06616028398275375, -0.047832075506448746, 0.04784069582819939, 0.03832627087831497, -0.029649199917912483, -0.06844017654657364, -0.008952353149652481, 0.05289160832762718, 0.028694145381450653, 0.05181392654776573, 0.020129330456256866, 0.021505819633603096, -0.09388633072376251, -0.02972271665930748, -0.04194201901555061, -0.045028746128082275, 0.031106693670153618, -0.003130500903353095, -0.0004087712150067091, -0.049304332584142685, -0.007405213546007872, -0.019403481855988503, 0.01804429665207863, 0.041406385600566864, 0.013496072962880135, 0.00020067376317456365, 0.03307151049375534, -0.008114888332784176, 0.0010335914557799697, 0.014435600489377975, 0.022068606689572334, -0.05171823874115944, 0.05190274119377136, 0.054438408464193344, -0.004647126421332359, -0.022298159077763557, -0.015246162191033363, -0.005647444631904364, -0.010721747763454914, 0.03168685361742973, 0.011437362991273403, 0.00021485057368408889, -0.0039003530982881784, 0.03356613218784332, -0.01920986734330654, 0.07681982964277267, 0.06855490058660507, -0.00036492524668574333, -0.025292355567216873, 0.016116993501782417, -0.021083887666463852, -0.02806025557219982, 0.029515964910387993, -0.014449425972998142, 0.041490230709314346, 0.031984735280275345, -0.00968278106302023, 0.05491006374359131, 0.029963357374072075, -0.008249678649008274, 0.05000854656100273, -0.002528170123696327, -0.034165624529123306, -0.022024625912308693, -0.006611219607293606, -0.008190717548131943, 0.005341976415365934, 0.006035271100699902, -0.2600844204425812, 0.035281579941511154, -0.009719186462461948, 0.016888072714209557, 0.014924420043826103, 0.035371143370866776, 0.08099090307950974, -0.023488115519285202, 0.014852060936391354, 0.09281044453382492, -0.011761825531721115, 0.04769840091466904, -0.004627248737961054, -0.05820038542151451, 0.002204993972554803, 0.05211088806390762, 0.08652340620756149, 0.03956949710845947, -0.0531298890709877, 0.055530332028865814, 0.002228574128821492, -0.021259984001517296, 0.18169550597667694, -0.0005748576368205249, 0.00034537489409558475, -0.005675121210515499, -0.014851314947009087, -0.03685943782329559, 0.08649151772260666, 0.018232177942991257, 0.050065167248249054, 0.03276069462299347, 0.05617247521877289, -0.06321007758378983, 0.034356292337179184, 0.03765718266367912, -0.016790179535746574, 0.06639930605888367, 0.032324861735105515, -0.015596810728311539, -0.013939437456429005, 0.005211306735873222, 0.010129892267286777, -0.01576829142868519, 0.03896315023303032, 0.001177297905087471, 0.00650873314589262, -0.04477843642234802, -0.013783033937215805, 0.031078973785042763, -0.01229907851666212, 0.018727045506238937, -0.009251873008906841, -0.023996062576770782, 0.016067752614617348, 0.07398699223995209, -0.0032975119538605213, -0.03000413440167904, 0.024461092427372932, 0.020624354481697083, 0.01622706465423107, -0.002944785635918379, 0.09645792841911316, 0.07027260214090347, 0.04744192957878113]\n",
      "[-0.043674420565366745, -0.004805954173207283, 0.00838705338537693, -0.060562510043382645, 0.06327366083860397, -0.04909627512097359, -0.02915825881063938, -0.01856774277985096, -0.032372649759054184, -0.011185684241354465, 0.05564870685338974, 0.051745813339948654, -0.006327012088149786, -0.05421573668718338, 0.039140041917562485, -0.03520907089114189, 0.04401310533285141, 0.002326762303709984, -0.004399774130433798, 0.020194407552480698, 0.0526866652071476, -0.013247760012745857, -0.0074508171528577805, -0.068437859416008, 0.010829494334757328, 0.008263296447694302, 0.04013163223862648, -0.023332271724939346, -0.05559774488210678, -0.1929854452610016, 0.015691356733441353, 0.007911627180874348, 0.024212609976530075, 0.015315533615648746, -0.00681592570617795, -0.04356231167912483, -0.01511925645172596, -0.06570512801408768, -0.009465807117521763, -0.021364694461226463, 0.05252857506275177, -0.013064863160252571, 0.050050217658281326, 0.01555260457098484, 0.011722134426236153, -0.071811743080616, -0.02901308983564377, -0.06036170572042465, 0.08633643388748169, 0.018411017954349518, 0.03533518686890602, 0.04252246022224426, 0.0348043292760849, -0.033660925924777985, -0.037173546850681305, -0.026883650571107864, 0.06591972708702087, 0.06728392839431763, 0.038403332233428955, -0.016560286283493042, -0.024566128849983215, 0.06051751971244812, -0.11811555176973343, 0.08269362896680832, 0.03746702894568443, -0.054707445204257965, 0.021637147292494774, -0.04233894124627113, -0.006172380410134792, 0.0442875511944294, -0.10977856814861298, 0.01796899363398552, -0.06751590967178345, 0.05849287286400795, -0.0211478304117918, -0.09954147785902023, 0.030678804963827133, 0.002838712651282549, 0.02164435386657715, -0.02660350874066353, -0.009150831028819084, -0.018207082524895668, -0.018400389701128006, 0.005700543988496065, 0.019771171733736992, 0.0009612494613975286, -0.04153775796294212, 0.049567729234695435, -0.018765795975923538, -0.024987248703837395, -0.05148854851722717, -0.06976746022701263, 0.04186522215604782, 0.008735074661672115, -0.005305577535182238, -0.02705458551645279, -0.0007589766173623502, 0.061240505427122116, -0.010115859098732471, 0.40260252356529236, -0.0003881333686877042, -0.02529308572411537, -0.009961314499378204, -0.015398558229207993, 0.006823021452873945, -0.009450232610106468, 0.015010385774075985, 0.07536086440086365, 0.037081528455019, 0.05705070495605469, 0.005963635630905628, -0.027225540950894356, 0.010724656283855438, -0.0465855747461319, 0.042119476944208145, -0.04038923233747482, -0.0381971038877964, 0.007653119508177042, -0.03565056249499321, -0.025782449170947075, -0.01451029907912016, -0.01924605295062065, 0.057446639984846115, 0.00021961260063108057, 0.08048193901777267, -0.0026759959291666746, 0.02203408069908619, 0.014638192020356655, 0.029176943004131317, 0.049281179904937744, 0.017223747447133064, -0.10015491396188736, -0.06480728834867477, -0.02860335074365139, -0.003280794247984886, 0.08379652351140976, -0.027911417186260223, -0.03124641440808773, -0.009497689083218575, -0.027409514412283897, 0.022305546328425407, 0.001568517298437655, 0.13183173537254333, 0.03260112926363945, -0.023213356733322144, 0.05123523622751236, -0.04373569041490555, -0.023942939937114716, -0.0007705026655457914, -0.03424244374036789, 0.04275645315647125, 0.007332851178944111, -0.031582776457071304, -0.051697757095098495, -0.01538057904690504, -0.008647610433399677, 0.04109330102801323, 0.0022700743284076452, -0.07137659192085266, 0.018729154020547867, -0.0257217176258564, -0.03068612329661846, -0.011121603660285473, 0.05249734967947006, 0.045525044202804565, -0.03639711067080498, 0.0017624985193833709, 0.02178049646317959, 0.044969577342271805, -0.041382793337106705, 0.001184054184705019, -0.02219633013010025, 0.05207376182079315, -0.03671874850988388, 0.06701087951660156, -0.020763400942087173, 0.0003036763519048691, 0.04263155162334442, -0.01767641119658947, 0.010252009145915508, 0.02537301555275917, -0.03368130698800087, -0.030626684427261353, 0.0023530905600637197, 0.005434539169073105, 0.00013866942026652396, -0.02010600082576275, 0.009305605664849281, -0.030073072761297226, 0.017454268410801888, -0.017167488113045692, 0.03785417973995209, -0.08909816294908524, -0.09082042425870895, -0.003906733822077513, 0.025343596935272217, 0.022998526692390442, -0.019629186019301414, -0.06247576326131821, 0.01975051686167717, 0.018064703792333603, 0.02572745271027088, 0.012952438555657864, 0.001578647643327713, -0.01497158594429493, 0.009092375636100769, 0.021322553977370262, -0.03923628479242325, 0.026652740314602852, -0.040507182478904724, -0.07700124382972717, -0.012632244266569614, 0.022306187078356743, 0.022805701941251755, -0.09994634985923767, -0.03517996519804001, -0.013693965040147305, 0.018625784665346146, 0.038984693586826324, 0.04785984754562378, -0.00926111452281475, -0.06675852090120316, -0.0716266930103302, -0.3190212845802307, -0.030295031145215034, -0.02031775936484337, -0.0008557735127396882, 0.04405749589204788, -0.05346137657761574, 0.05769217014312744, 0.03219153359532356, -0.045786891132593155, -0.04334522783756256, 0.10573520511388779, -0.04945668578147888, 0.0267969761043787, -0.05843988433480263, 0.012294781394302845, 0.0027555900160223246, 0.024594621732831, -0.047121286392211914, -0.004325682297348976, -0.014649607241153717, 0.012587073259055614, -0.025699365884065628, 0.046036817133426666, -0.02148553542792797, 0.01094727497547865, 0.033019404858350754, 0.09947706013917923, 0.017629604786634445, 0.102360799908638, -0.022167513146996498, 0.06700479984283447, 0.01608169637620449, 0.018972091376781464, -0.12244080752134323, -0.05079526826739311, -0.004541815724223852, 0.00032535489299334586, 0.019589293748140335, 0.00816548801958561, 0.013213656842708588, -0.010509920306503773, -0.013595457188785076, -0.009759506210684776, -0.004241930320858955, 0.00036090347566641867, -0.022771064192056656, 0.05900399014353752, 0.005695546045899391, 0.027137350291013718, -0.022318249568343163, -0.019751181825995445, 0.004302787594497204, -0.031157905235886574, 0.02202402800321579, 0.02804323472082615, -0.08756092190742493, 0.002857842016965151, -0.02408973127603531, 0.025111133232712746, -0.025169162079691887, 0.04195847734808922, 0.04481283947825432, 0.012113580480217934, -0.0194231104105711, 0.0029820348136126995, -0.014128867536783218, -0.04931120574474335, 0.02452918328344822, 0.05605892091989517, -0.00910322554409504, -0.06601400673389435, 0.012053336016833782, -0.02488694153726101, 0.06258413940668106, 0.0683789998292923, 0.031171860173344612, 0.026037391275167465, 0.026261571794748306, -0.03935245797038078, -0.030264267697930336, 0.004003989044576883, -0.005769912153482437, 0.0628850907087326, 0.010062506422400475, 0.0028658322989940643, -0.0035922685638070107, 0.022984474897384644, -0.026359260082244873, 0.02864854224026203, 0.002714025555178523, -0.04757944867014885, -0.06033581867814064, 0.006784498225897551, 0.011475949548184872, 0.017387045547366142, 0.028321564197540283, -0.2633856534957886, 0.017118025571107864, 0.0155797079205513, 0.04487244039773941, 0.0024163806810975075, -0.005086430348455906, 0.05145369842648506, -0.021358028054237366, -0.04849844053387642, 0.03063173219561577, 0.013508693315088749, 0.03467019274830818, -0.013087932951748371, -0.03890400379896164, 0.038507115095853806, -0.003928645513951778, 0.10691017657518387, 0.09011605381965637, 0.017007341608405113, -0.018244680017232895, -0.0077079650945961475, -0.020044943317770958, 0.1534920483827591, -0.008659345097839832, 0.01882123574614525, 0.007528072223067284, 0.01695217937231064, -0.0466206856071949, 0.017083140090107918, 0.03141482546925545, 0.06638574600219727, 0.029058724641799927, 0.04257719963788986, -0.01743163727223873, 0.018364109098911285, -0.016433652490377426, 0.015016901306807995, 0.028792455792427063, 0.04877753555774689, 0.018481038510799408, -0.027130309492349625, -0.023613128811120987, -0.08700604736804962, -0.0108067337423563, 0.09939636290073395, -0.04149118438363075, 0.02376774325966835, -0.029457716271281242, 0.011172372847795486, 0.020924221724271774, -0.017843322828412056, 0.008610684424638748, -0.007750640623271465, 0.012332095764577389, -0.008661460131406784, 0.004954148083925247, -0.036686524748802185, 0.011452997103333473, 0.025265973061323166, -0.027754738926887512, 0.024893801659345627, 0.013387328013777733, 0.11001018434762955, 0.06150384619832039, 0.014253247529268265]\n",
      "[-0.055785007774829865, 0.005135401152074337, -0.00647704629227519, -0.04081137850880623, 0.033101942390203476, -0.026547934859991074, -0.024050408974289894, -0.007340379059314728, -0.029914289712905884, 0.014534516260027885, 0.04079267010092735, 0.027716821059584618, 0.011917496100068092, -0.0431254506111145, 0.043779995292425156, -0.02363433875143528, -0.014223139733076096, -0.015106294304132462, -0.028557339683175087, 0.03905060142278671, 0.02990676462650299, 0.039452482014894485, 0.01034602988511324, -0.033463429659605026, -0.0035449001006782055, 0.0017870713490992785, 0.013473938219249249, -0.019929014146327972, -0.03635610267519951, -0.19380123913288116, 0.036914825439453125, 0.02370351180434227, 0.004827885888516903, 0.0014639641158282757, 0.026980917900800705, 0.0005146433832123876, -0.01517946645617485, -0.0757724940776825, -0.02824806608259678, -0.009710066951811314, 0.07862958312034607, -0.014501676894724369, 0.039974600076675415, -0.03221374377608299, 0.004604979418218136, -0.08883330225944519, -0.03575398400425911, -0.055919378995895386, 0.09744659066200256, 0.017679397016763687, 0.008539015427231789, 0.036656346172094345, 0.038251571357250214, -0.03182878717780113, -0.03016633167862892, -0.03337493911385536, 0.03788922354578972, 0.0627291277050972, -0.0103690717369318, -0.034444019198417664, -0.01607205718755722, 0.04500359296798706, -0.15823403000831604, 0.08214817941188812, 0.05136532709002495, -0.05167992413043976, 0.014727035537362099, 5.0046750402543694e-05, -0.04796995222568512, 0.06135838106274605, -0.08185268938541412, -0.008515694178640842, -0.07697092741727829, 0.0786278247833252, -0.014454418793320656, -0.06505177915096283, -0.0055886199697852135, 0.01518280990421772, 0.03462417796254158, -0.038933176547288895, -0.026575380936264992, -0.027396930381655693, -0.023246942088007927, 0.0158571507781744, -0.01412319764494896, -0.026237180456519127, -0.019549302756786346, 0.04990733787417412, -0.02215518243610859, 0.01373113039880991, -0.04601375386118889, -0.06211812049150467, 0.07285679876804352, 0.022803092375397682, -0.032800838351249695, -0.011359437368810177, 0.012977623380720615, 0.06381599605083466, -0.033612389117479324, 0.3777143061161041, 0.0036674607545137405, -0.01783132366836071, -0.0047904024831950665, -0.007949848659336567, 0.0095335328951478, -0.014155064709484577, 0.023074574768543243, 0.06809687614440918, 0.0734899491071701, 0.06333016604185104, 0.03153364732861519, -0.024478895589709282, 0.027648285031318665, -0.08507324010133743, -0.0013617383083328605, -0.01911853440105915, -0.0021703019738197327, 0.0021393639035522938, -0.055677380412817, -0.002122816164046526, 0.005666470155119896, -0.021666795015335083, 0.002946763299405575, -0.011353558860719204, 0.060144033282995224, 0.002882798667997122, 0.039233189076185226, 0.022825993597507477, -0.0014807069674134254, 0.023853525519371033, 0.03173702210187912, -0.07329202443361282, -0.061659928411245346, -0.027572602033615112, -0.03014965169131756, 0.07766267657279968, -0.044042423367500305, -0.025812748819589615, 0.018138235434889793, -0.0313103087246418, -0.005389126483350992, -0.04677501693367958, 0.09938586503267288, 0.047110624611377716, -0.040681324899196625, 0.013674147427082062, -0.05730662867426872, -0.03580305725336075, -0.0016412900295108557, -0.02488243207335472, 0.011588115245103836, -0.004699226468801498, -0.008856577798724174, -0.04150177910923958, -0.008934065699577332, -0.003534559393301606, 0.027461092919111252, 0.05511908605694771, -0.060526877641677856, -0.0006518822046928108, -0.030880950391292572, -0.026185816153883934, -0.011200456880033016, 0.01670227013528347, 0.0395098440349102, -0.0038655635435134172, -0.026718104258179665, -0.00578699866309762, 0.052781060338020325, -0.10250009596347809, -0.0023017616476863623, -0.04741308465600014, 0.03502725064754486, -0.07071442902088165, 0.06803075224161148, -0.033408962190151215, 0.054888878017663956, 0.0006997569580562413, -0.0010678477119654417, 0.010271934792399406, 0.01399228721857071, -0.03093845397233963, -0.05696753039956093, -0.02052230015397072, 0.01301367674022913, 0.015440993942320347, -0.03478735312819481, -0.014006107114255428, -0.009380224160850048, 0.042315732687711716, 0.01283593475818634, 0.01577138341963291, -0.09116480499505997, -0.08887428045272827, -0.008208297193050385, 0.013531452976167202, 0.0491514727473259, 0.00463881716132164, -0.04705332592129707, 0.022918423637747765, 0.05014627426862717, 0.02310054749250412, -0.003984461072832346, 0.006785060744732618, -0.029609059914946556, -0.0004062436055392027, 0.062343064695596695, -0.003550146473571658, 0.039046525955200195, -0.00014806544641032815, -0.06105939298868179, 0.004881155211478472, 0.020560286939144135, 0.0324593223631382, -0.09991761296987534, -0.0027163969352841377, 0.004794327076524496, -0.011770110577344894, 0.03860944136977196, 0.013016520999372005, -0.020161686465144157, -0.06496085971593857, -0.051405925303697586, -0.30929672718048096, -0.06440725177526474, 0.02527124248445034, 0.0228518508374691, 0.059768058359622955, -0.10771381855010986, 0.020434847101569176, 0.017904574051499367, 0.002585582435131073, -0.06787168979644775, 0.09284137934446335, -0.050683584064245224, 0.00915770698338747, -0.050705328583717346, 0.03345377370715141, 0.0068068476393818855, 0.04116903990507126, -0.007004160899668932, 0.051765576004981995, 0.013853414915502071, -0.0049998462200164795, -0.045331791043281555, 0.009262537583708763, -0.045598648488521576, 0.0017073294147849083, 0.05632475018501282, 0.08526936173439026, -0.0006602408830076456, 0.1293535977602005, -0.013321791775524616, 0.08337102830410004, 0.013171845115721226, -0.0037774911615997553, -0.11299717426300049, -0.03547384962439537, -0.005286848172545433, 0.014817845076322556, 0.04691532999277115, 0.009342391043901443, -0.004295914433896542, -0.03415742516517639, -0.027031665667891502, -0.01580701768398285, 0.01257245521992445, 0.014782114885747433, -0.046716008335351944, -0.0033458874095231295, 0.010477373376488686, 0.012875529006123543, -0.0214985478669405, -0.0029389781411737204, 0.04116158187389374, -0.00985732115805149, 0.0004435534356161952, -0.006233766209334135, -0.06631646305322647, 0.018423737958073616, -0.030704107135534286, 0.04091029241681099, -0.052460070699453354, 0.040990568697452545, 0.10303473472595215, 0.03693925216794014, -0.020236486569046974, -0.03678697347640991, -0.048543740063905716, -0.04669473320245743, 0.06026545912027359, 0.044821590185165405, -0.04234035685658455, -0.04960831627249718, 0.0022142548114061356, -0.009664916433393955, 0.08653435111045837, 0.052139781415462494, 0.017363088205456734, 0.014614957384765148, -0.012939872220158577, -0.06381040066480637, -0.012131630443036556, 0.03505828231573105, -0.013111133128404617, 0.07457207143306732, -0.005122963339090347, -0.02595224417746067, 0.03376500681042671, 0.036794766783714294, -0.02212407812476158, 0.028257356956601143, -0.012027218006551266, -0.03177180141210556, -0.06849522143602371, 0.02021152339875698, -0.0065843104384839535, -0.0033323548268526793, 0.036127690225839615, -0.25756749510765076, -0.011961893178522587, -0.013954849913716316, 0.016912348568439484, 0.04110698029398918, -0.015534576028585434, 0.053767409175634384, -0.03753063455224037, -0.07219421863555908, 0.046464934945106506, 0.04415437951683998, 0.06472132354974747, -0.025577902793884277, -0.016914742067456245, 0.029360514134168625, 0.009018033742904663, 0.052991703152656555, 0.050788115710020065, -0.0012565333163365722, -0.0114543866366148, 0.030488522723317146, -0.0455230250954628, 0.12989184260368347, -0.0033409330062568188, 0.03321172297000885, 0.01785091497004032, 0.015688464045524597, -0.028382958844304085, 0.0623052641749382, 0.014150293543934822, 0.03498699888586998, 0.04465419054031372, 0.07043936848640442, -0.01679706946015358, 0.03140440955758095, -0.03236585110425949, 0.028639061376452446, 0.05327663943171501, 0.046201832592487335, -0.003524994943290949, -0.0618879571557045, 0.0029647848568856716, -0.032922521233558655, -0.04112653806805611, 0.0945286676287651, -0.020498117431998253, 0.03076573833823204, -0.008810733444988728, -0.01014130562543869, 0.05505459010601044, -0.010345900431275368, 0.012126225978136063, 0.0034939961042255163, 0.015552839264273643, 0.0254072155803442, 0.052748288959264755, -0.029466915875673294, -0.0009938174625858665, -0.00275029637850821, -0.01890379935503006, 0.04537275806069374, 0.017309097573161125, 0.10092460364103317, 0.04489089548587799, 0.0627647340297699]\n",
      "[-0.05039351433515549, -0.044145550578832626, 0.013225264847278595, -0.04599084332585335, 0.007345666643232107, -0.035190846771001816, -0.0057051461189985275, -0.026404088363051414, -0.005515919532626867, -0.0662018284201622, 0.019317565485835075, 0.052891574800014496, -0.006131655536592007, -0.01306754257529974, 0.020736798644065857, -0.030776480212807655, 0.03117884323000908, -0.03064437210559845, -0.017176885157823563, 0.034287720918655396, -0.0004888852126896381, 0.012831334955990314, -0.012854473665356636, -0.03600000590085983, -0.021937359124422073, 0.0359230637550354, 0.021901080384850502, -0.03858177736401558, -0.06116320565342903, -0.18190599977970123, -0.03176399692893028, -0.02301730215549469, 0.02851748839020729, -0.01624276302754879, -0.008320651017129421, -0.03410833701491356, -0.0035472940653562546, -0.047049377113580704, -0.039160940796136856, -0.047283340245485306, 0.07881678640842438, -0.01634422317147255, 0.03436282277107239, -0.011655623093247414, 0.007295857183635235, -0.07100361585617065, -0.023232778534293175, -0.05765378102660179, 0.06205189600586891, -0.021135462448000908, -0.03140734136104584, 0.027221130207180977, 0.05767057463526726, -0.031670887023210526, -0.041692957282066345, -0.014582829549908638, 0.008473534137010574, 0.05936537683010101, 0.025201071053743362, 0.02234923467040062, -0.013015449978411198, 0.06608801335096359, -0.13365596532821655, 0.08598052710294724, 0.062387097626924515, -0.03765346109867096, 0.01597488671541214, -0.06284135580062866, -0.015716638416051865, 0.03678107634186745, -0.032592423260211945, -0.029520556330680847, -0.041354842483997345, 0.07925575226545334, -0.027999235317111015, -0.0771048441529274, 0.06393628567457199, -0.025049425661563873, 0.00042705709347501397, 0.007980494759976864, -0.06573055684566498, -0.016149528324604034, 0.01369798555970192, 0.04531132057309151, 0.02347371354699135, -0.005817054770886898, -0.009954768233001232, 0.021783096715807915, -0.017934899777173996, -0.004982328973710537, -0.05453242361545563, -0.02471640706062317, 0.022674351930618286, 0.0009912323439493775, -0.08579438179731369, -0.018112026154994965, 0.017512457445263863, 0.07996971905231476, -0.061780087649822235, 0.40658804774284363, -0.03495464473962784, 0.00021692652080673724, 0.030747679993510246, -0.04680033400654793, 0.02432173304259777, 0.005039244890213013, 0.08437826484441757, 0.03757617995142937, 0.019736338406801224, 0.03276681527495384, 0.05237698554992676, -0.030235018581151962, 0.05935012549161911, -0.06495387107133865, 0.030103320255875587, 0.0043198284693062305, -0.02378988452255726, 0.02956249937415123, -0.04791030287742615, 0.03392079100012779, 0.005484724882990122, 0.01434940006583929, 0.005005983170121908, 0.014094537124037743, 0.09425273537635803, -0.027112765237689018, -0.009220603853464127, 0.05064506456255913, 0.024174004793167114, -0.023401005193591118, -0.019267961382865906, -0.0536978580057621, -0.03543996438384056, -0.01896483637392521, 0.013537896797060966, 0.07303979247808456, -0.04843985661864281, 0.007894739508628845, 0.04707246646285057, -0.10071945190429688, 0.0440182127058506, -0.00411894079297781, 0.07905007153749466, 0.052737776190042496, -0.028876537457108498, 0.0846242755651474, -0.01640719175338745, 0.015338663943111897, -0.005351238418370485, -0.027376707643270493, 0.044723086059093475, 0.0027612848207354546, -0.005464245565235615, -0.07902111858129501, -0.005837771575897932, 0.0024542752653360367, 0.020392905920743942, 0.029839834198355675, 6.327225128188729e-05, -0.0006096363067626953, -0.06054116412997246, -0.02941051684319973, -0.018763644620776176, 0.01970728486776352, 0.012896507047116756, -0.025581784546375275, -0.032865434885025024, 0.032160237431526184, -0.007841682992875576, -0.06348209083080292, -0.0006022295565344393, 0.02854803577065468, 0.07821643352508545, -0.03921177238225937, 0.054300036281347275, -0.03214513137936592, 0.025467712432146072, -0.009767086245119572, 0.03753509745001793, -0.004666474182158709, 0.0208843182772398, -0.03683675080537796, -0.032429471611976624, 0.010054548271000385, -0.010649378411471844, 0.017231574282050133, -0.030602596700191498, 0.0514245480298996, 0.005160318221896887, 0.055213563144207, -0.003906602039933205, -0.006156910676509142, 0.011830533854663372, -0.04645052179694176, -0.05017990618944168, -0.04035573452711105, -0.003151842625811696, -0.022326786071062088, 0.02492140792310238, -0.04167460650205612, 0.05713745951652527, -0.000974784605205059, -0.010427669622004032, 0.016247624531388283, -0.04520931467413902, -0.04386837035417557, 0.04367462918162346, -0.005086463876068592, 0.07403984665870667, -0.018374746665358543, -0.05202941596508026, -0.0008358233608305454, -0.0014155091485008597, -0.025627827271819115, -0.07051179558038712, -0.01725386269390583, -0.056984931230545044, 0.00325222359970212, -0.008669574744999409, 0.028363671153783798, 0.012583843432366848, -0.037358224391937256, -0.06442508846521378, -0.327825129032135, -0.04300424084067345, 0.0010530123254284263, 0.022511685267090797, 0.0406004823744297, -0.07140452414751053, 0.014909044839441776, 0.007002570200711489, -0.003480089595541358, -0.016162797808647156, 0.10292356461286545, -0.022109853103756905, 0.019199920818209648, -0.049309730529785156, 0.10281983762979507, 0.03395673632621765, -0.0038234214298427105, -0.08332781493663788, -0.0035315919667482376, 0.04394657909870148, 0.002092996845021844, -0.04899846017360687, -0.05278269574046135, -0.08059028536081314, 0.04253523796796799, 0.0005746626411564648, 0.07491381466388702, 0.021315496414899826, 0.10357210040092468, -0.08674159646034241, 0.06312292069196701, 0.06906373798847198, -0.009349353611469269, -0.10667379945516586, 0.0073688095435500145, 0.02591569349169731, -0.0046334718354046345, 0.09207192808389664, 0.012006787583231926, 0.016521770507097244, -0.028159774839878082, 0.007323934230953455, -0.04191327840089798, -0.014404184184968472, -0.03972509130835533, -0.04950110986828804, -0.015216493047773838, -0.016824813559651375, 0.0013675519730895758, 0.03094993345439434, 0.014676290564239025, 0.04336850717663765, -0.012614489533007145, 0.0349530391395092, 0.015400155447423458, -0.07886367291212082, -0.002062475308775902, 0.017065664753317833, 0.007472577970474958, -0.024374838918447495, 0.05012000724673271, 0.04035520553588867, -0.00280971871688962, -0.013007735833525658, -0.0039447154849767685, 0.00947558879852295, -0.050284065306186676, 0.024115219712257385, 0.0492779016494751, -0.017654020339250565, -0.04188215732574463, 0.05608602613210678, -0.014134424738585949, 0.07183423638343811, 0.06244475767016411, 0.02433864399790764, 0.015245706774294376, 0.031415488570928574, -0.006771404761821032, -0.019277423620224, 0.04577047750353813, 0.006093996576964855, 0.04762008413672447, -0.00010976087651215494, -0.041209232062101364, 0.025601277127861977, 0.02370935119688511, 0.0037701032124459743, 0.021243713796138763, 0.021005211398005486, -0.0539228692650795, -0.032838452607393265, -0.01023674476891756, -0.01858566328883171, 0.018294548615813255, 0.03284267708659172, -0.25539055466651917, 0.025457121431827545, -0.007428782992064953, 0.032087817788124084, -0.004027395974844694, 0.015215326100587845, 0.052974335849285126, -0.02215505577623844, -0.01180814579129219, 0.01812892220914364, -0.03722509369254112, 0.04309051111340523, -0.030261030420660973, -0.05017520859837532, 0.01934896409511566, -0.025446860119700432, 0.09345978498458862, -0.00023262703325599432, -0.010459765791893005, -0.0020694180857390165, -0.04691534489393234, 0.033231694251298904, 0.16145828366279602, -0.020953841507434845, -0.026817115023732185, -0.028408484533429146, 0.054995372891426086, -0.010836406610906124, 0.0549105666577816, 0.028320809826254845, 0.04574450105428696, -0.019227946177124977, -0.026620445773005486, -0.013314452953636646, 0.015297727659344673, -0.03583766520023346, 0.04816233366727829, 0.04151715710759163, 0.033169716596603394, -0.021674180403351784, 0.005832549184560776, 0.005622406490147114, -0.08044561743736267, -0.007249647285789251, 0.012348433025181293, -0.007387399207800627, 0.01123408880084753, 0.024340903386473656, -0.024565111845731735, 0.0017989416373893619, 0.0281671192497015, -0.03789086639881134, 0.03523355349898338, 0.009916961193084717, 0.019401375204324722, 0.06555217504501343, -0.002619741251692176, 0.009334099479019642, 0.029573695734143257, -0.011503859423100948, 0.07096060365438461, 0.026284074410796165, 0.10962744802236557, 0.006241363473236561, 0.05029445141553879]\n",
      "[-0.06729456782341003, -0.02215787209570408, 0.025686245411634445, -0.049632735550403595, 0.01044522225856781, -0.007802397944033146, -0.022234434261918068, -0.013582787476480007, -0.018864216282963753, -0.04233713075518608, 0.015229792334139347, 0.016694052144885063, -0.0059313783422112465, -0.007082692347466946, 0.04891432821750641, -0.015036305412650108, 0.03560749441385269, -0.06479613482952118, -0.028837695717811584, 0.017514890059828758, 0.03626474365592003, 0.018909327685832977, -0.013719082809984684, 0.00410985853523016, -0.02341419830918312, 0.034727130085229874, 0.044148627668619156, -0.051029521971940994, -0.05290208011865616, -0.1736665666103363, -0.0015855374513193965, -0.02753261663019657, 0.017485838383436203, 0.0028274187352508307, 0.025252094492316246, 0.0019832809921354055, -0.016828501597046852, 0.0007103541865944862, -0.06779993325471878, 0.0277844425290823, 0.06831847131252289, -0.006942655425518751, 0.032152824103832245, -0.0015212827129289508, 0.03180969879031181, -0.048692237585783005, -0.012305852957069874, -0.05198492854833603, 0.05046922340989113, -0.05631536245346069, -0.06543850153684616, -0.016690243035554886, 0.011662017554044724, -0.02725890278816223, -0.03155439347028732, -0.026067981496453285, 0.0698137953877449, 0.0694296732544899, -0.0008193319663405418, 0.009222586639225483, -0.036188069730997086, 0.03094024583697319, -0.16407082974910736, 0.08361242711544037, 0.034976471215486526, -0.008075249381363392, -0.0047407676465809345, -0.016187099739909172, -0.007412183564156294, 0.057484570890665054, -0.04943659529089928, -0.017708126455545425, -0.010451708920300007, 0.08120786398649216, -0.013273523189127445, -0.01060212217271328, 0.017386382445693016, 0.019024856388568878, 0.0216812826693058, -0.04492008686065674, -0.05771271511912346, -0.015362530015408993, 0.03385229408740997, -0.021028965711593628, -0.012840022332966328, -0.026413215324282646, -0.024369288235902786, 0.04772065207362175, -0.023151880130171776, 0.013840120285749435, -0.01978459395468235, -0.03466577082872391, 0.02528505027294159, 0.030368046835064888, -0.03552253544330597, -0.02485707588493824, 0.005959663540124893, 0.0681050717830658, 0.006181218195706606, 0.459579199552536, -0.05206534266471863, 8.125937711156439e-06, 0.03308173269033432, -0.03058790974318981, -0.012731908820569515, -0.01894114725291729, 0.055598676204681396, 0.030169913545250893, 0.04292325675487518, 0.00033484792220406234, 0.028415527194738388, -0.00870634987950325, 0.05807238072156906, -0.0549318753182888, 0.028377484530210495, 0.07178279757499695, 0.05736490339040756, 0.006422128528356552, -0.05291297286748886, 0.012499043717980385, 0.02259780839085579, -0.00525355851277709, 0.020566966384649277, -0.030798446387052536, 0.0859113335609436, -0.07782644033432007, -0.0010624779388308525, 0.03739865496754646, 0.028721844777464867, 0.06201278045773506, 0.034989986568689346, -0.033145472407341, -0.01990116387605667, 0.0030074305832386017, 0.03335186466574669, 0.051474425941705704, -0.01379380002617836, -0.0367240384221077, 0.02934650145471096, -0.043837834149599075, 0.013635204173624516, -0.03454747796058655, -0.0013663520803675056, -0.024975590407848358, -0.060309115797281265, 0.0703606978058815, 0.001932914718054235, 0.010165488347411156, -0.007523385342210531, -0.04222843796014786, 0.0335991308093071, 0.01479534525424242, 0.01554114930331707, -0.07567595690488815, -0.005244511179625988, -0.045932475477457047, 0.0940127745270729, 0.055983372032642365, -0.03235253691673279, -0.024725602939724922, -0.06418780982494354, -0.01920212060213089, 0.0054198880679905415, 0.027414470911026, 0.018339846283197403, -0.019553611055016518, -0.050136398524045944, 0.00046814538654871285, 0.0673488900065422, -0.06692236661911011, 0.024562662467360497, -0.00532139977440238, 0.029825670644640923, 0.008178559131920338, 0.09561799466609955, -0.029046881943941116, 0.02232983522117138, 0.017700346186757088, 0.06066304072737694, 0.026291627436876297, -0.007708896417170763, -0.050847943872213364, -0.017623402178287506, -0.01569950021803379, -0.012734124436974525, 0.013386587612330914, -0.04263770952820778, 0.012432376854121685, -0.02045603096485138, 0.0527486577630043, 0.01248215977102518, 0.03067345917224884, -0.05354902148246765, 0.0014826535480096936, -0.08397557586431503, -0.06276747584342957, 0.029104871675372124, 0.00795379001647234, -0.021054932847619057, -0.012729234993457794, 0.017387425526976585, -0.005509418435394764, -0.035884007811546326, 0.04131939262151718, -0.06200538948178291, -0.025098130106925964, 0.04859581217169762, 0.014794196002185345, 0.1002628281712532, 0.002120050135999918, -0.03963695839047432, -0.04461922124028206, 0.0251498743891716, 0.011937805451452732, -0.0005024443380534649, 0.005218158476054668, -0.02050580270588398, -0.018485689535737038, -0.0008232104009948671, 0.015113641507923603, -0.03944868594408035, 0.010085808113217354, -0.03568117320537567, -0.3139837682247162, -0.01832365244626999, -0.000243999034864828, 0.006190640386193991, 0.0762496143579483, -0.05804625153541565, 0.05615606531500816, 0.015201599337160587, 0.013552658259868622, -0.06356383115053177, 0.08498446643352509, -0.043628375977277756, 0.024169791489839554, -0.07327421009540558, 0.03547866269946098, 0.030285976827144623, 0.029721861705183983, -0.014473957009613514, -0.040567174553871155, 0.023463228717446327, -0.01629876159131527, -0.014825277030467987, -0.05454033985733986, -0.04086320102214813, 0.0017518758540973067, 0.02157008834183216, 0.055732209235429764, 0.021164996549487114, 0.0754106342792511, 0.0077580236829817295, 0.0904931053519249, 0.016977421939373016, 0.005847254768013954, -0.14724552631378174, -0.007268470246344805, 0.00236876355484128, 0.018565677106380463, 0.02320992760360241, 0.044813722372055054, -0.03413339704275131, -0.04416386038064957, 0.002153341891244054, -0.03162073343992233, -0.028616778552532196, -0.04089318588376045, -0.029212452471256256, -0.029956631362438202, 0.025499003008008003, -0.014888898469507694, -0.014240325428545475, 0.01965753175318241, 0.004463030956685543, 0.006806869059801102, -0.02378096990287304, 0.006837535183876753, -0.06416045874357224, 0.003975416999310255, -0.023969236761331558, -0.030264167115092278, -0.01386183686554432, 0.031072106212377548, 0.05410490185022354, -0.01509870309382677, 0.016342323273420334, -0.04203949496150017, -0.010682940483093262, -0.01148204319179058, 0.023758308961987495, 0.031122274696826935, -0.03462628275156021, -0.02549777366220951, -0.00662285927683115, -0.031724393367767334, 0.013541540130972862, 0.04059991240501404, -0.003949873615056276, -0.003989015240222216, 0.019933592528104782, -0.03073275089263916, -0.0013283641310408711, 0.03937195613980293, -0.017204178497195244, 0.03311533108353615, 0.007193441968411207, -0.01880650594830513, 0.02672102302312851, 0.040474530309438705, -0.0026391868013888597, 0.04645179584622383, 0.029434826225042343, -0.03114205226302147, -0.022388258948922157, -0.026297079399228096, -0.029362918809056282, 0.039028994739055634, 0.01825234666466713, -0.2756262421607971, 0.01721258834004402, 0.01939976029098034, 0.037693820893764496, -0.027297060936689377, -0.008382558822631836, 0.052589286118745804, -0.047158174216747284, -0.004032966215163469, 0.033498845994472504, 0.008027666248381138, 0.05416564643383026, 0.0011391749139875174, -0.04068560153245926, 0.004961316008120775, 0.018133481964468956, 0.1321265995502472, 0.021601364016532898, -0.007510317489504814, 0.0036747229751199484, -0.040941666811704636, -0.013038739562034607, 0.1279321014881134, -0.005744118243455887, 0.05033561959862709, -0.015927590429782867, 0.01740407943725586, -0.03849678859114647, 0.07773248106241226, -0.02253558114171028, 0.036220528185367584, -0.002221290487796068, -0.011329269967973232, -0.06453236192464828, -0.03333904966711998, -0.025849267840385437, -0.005706301424652338, 0.08353962004184723, -0.021882474422454834, -0.020724575966596603, 0.012186741456389427, -0.05339574068784714, -0.034786421805620193, 0.002674652496352792, 0.0430317185819149, 0.016314590349793434, -0.00010074205783894286, -0.05665837600827217, -0.04146116226911545, 0.021236326545476913, 0.04397635906934738, -0.03625329211354256, 0.022829724475741386, 0.029116369783878326, 0.027422936633229256, 0.07905129343271255, 0.035348325967788696, -0.020314782857894897, 0.0034083412028849125, -0.03349647670984268, 0.010851883329451084, 0.01408165879547596, 0.11327489465475082, 0.0355936624109745, 0.05595626309514046]\n"
     ]
    }
   ],
   "source": [
    "for node in nodes:\n",
    "    node_embedding = embed_model.get_text_embedding(\n",
    "        node.get_content(metadata_mode=\"all\")\n",
    "    )\n",
    "    node.embedding = node_embedding\n",
    "    print(node_embedding)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {},
   "outputs": [],
   "source": [
    "query_str = \"Bash\"\n",
    "query_embedding = embed_model.get_query_embedding(query_str)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[-0.0655275285243988,\n",
       " 0.00894299615174532,\n",
       " -0.02082711085677147,\n",
       " -0.011000980623066425,\n",
       " -0.003246152773499489,\n",
       " -0.05166742578148842,\n",
       " -0.01613280549645424,\n",
       " 0.0027699004858732224,\n",
       " 0.027013229206204414,\n",
       " -0.014961343258619308,\n",
       " -0.01613481156527996,\n",
       " 0.020242992788553238,\n",
       " 0.055608779191970825,\n",
       " -0.038164157420396805,\n",
       " 0.02757468819618225,\n",
       " 0.006564107723534107,\n",
       " 0.009144391864538193,\n",
       " 0.10287594795227051,\n",
       " -0.014657911844551563,\n",
       " 0.03872257098555565,\n",
       " 0.0039942641742527485,\n",
       " 0.01933012530207634,\n",
       " 0.015650464221835136,\n",
       " -0.005154171027243137,\n",
       " -0.035742755979299545,\n",
       " 0.054819319397211075,\n",
       " 0.008804966695606709,\n",
       " -0.021953899413347244,\n",
       " -0.04366825893521309,\n",
       " -0.16800935566425323,\n",
       " 0.03506435826420784,\n",
       " 0.01266274694353342,\n",
       " 0.020349537953734398,\n",
       " 0.0025566352996975183,\n",
       " 0.05346674472093582,\n",
       " 0.061503782868385315,\n",
       " 0.019158581271767616,\n",
       " 0.04917735606431961,\n",
       " 0.01930895447731018,\n",
       " 0.02721797302365303,\n",
       " 0.06182744726538658,\n",
       " -0.027977142482995987,\n",
       " -0.015282899141311646,\n",
       " -0.00042416309588588774,\n",
       " -0.03840223327279091,\n",
       " -0.03003796562552452,\n",
       " 0.009033316746354103,\n",
       " -0.059672486037015915,\n",
       " 0.01615818403661251,\n",
       " -0.008101405575871468,\n",
       " -0.06909218430519104,\n",
       " -0.00965550635010004,\n",
       " 0.02554607391357422,\n",
       " -0.05898534879088402,\n",
       " 0.004323618020862341,\n",
       " 0.014257919043302536,\n",
       " 0.06443752348423004,\n",
       " 0.0350378192961216,\n",
       " 0.017051884904503822,\n",
       " -0.026069246232509613,\n",
       " 0.016631385311484337,\n",
       " 0.0144299091771245,\n",
       " -0.15364211797714233,\n",
       " 0.07357894629240036,\n",
       " 0.08045871555805206,\n",
       " 0.00760251097381115,\n",
       " -0.002353576710447669,\n",
       " -0.007385910488665104,\n",
       " -0.037207040935754776,\n",
       " 0.05340838059782982,\n",
       " -0.07400110363960266,\n",
       " -0.040946003049612045,\n",
       " -0.05775180831551552,\n",
       " 0.057354528456926346,\n",
       " -0.01713745854794979,\n",
       " 0.030918551608920097,\n",
       " -0.024956073611974716,\n",
       " -0.016966557130217552,\n",
       " 0.01235369686037302,\n",
       " -0.04560466855764389,\n",
       " -0.06534416973590851,\n",
       " -0.0042361728847026825,\n",
       " -0.043058525770902634,\n",
       " 0.01295747421681881,\n",
       " -0.0379364974796772,\n",
       " -0.07234914600849152,\n",
       " -0.0009161046473309398,\n",
       " 0.050361502915620804,\n",
       " 0.032396718859672546,\n",
       " -0.033992551267147064,\n",
       " -0.03519567474722862,\n",
       " -0.04125552624464035,\n",
       " 0.0678892433643341,\n",
       " 0.019672976806759834,\n",
       " -0.06367665529251099,\n",
       " -0.023642629384994507,\n",
       " 0.05547138303518295,\n",
       " 0.030260713770985603,\n",
       " 0.007953743450343609,\n",
       " 0.36127975583076477,\n",
       " 0.002777890767902136,\n",
       " 0.012560451403260231,\n",
       " 0.018821587786078453,\n",
       " -0.09674327075481415,\n",
       " 0.04370483011007309,\n",
       " 0.015499209053814411,\n",
       " 0.05655870959162712,\n",
       " 0.04968508332967758,\n",
       " 0.0019995879847556353,\n",
       " -0.01647675409913063,\n",
       " 0.04283532872796059,\n",
       " -0.04516208544373512,\n",
       " 0.06576249748468399,\n",
       " -0.05357412248849869,\n",
       " 0.009202097542583942,\n",
       " -0.00775961484760046,\n",
       " 0.007239254657179117,\n",
       " 0.033008284866809845,\n",
       " -0.020264729857444763,\n",
       " -0.0059938919730484486,\n",
       " -0.043872784823179245,\n",
       " -0.01198253408074379,\n",
       " 0.047894593328237534,\n",
       " 0.005976979620754719,\n",
       " 0.09433038532733917,\n",
       " -0.03484949469566345,\n",
       " 0.008069703355431557,\n",
       " 0.1016203835606575,\n",
       " -0.0096282372251153,\n",
       " 0.022880414500832558,\n",
       " 0.01847226545214653,\n",
       " -0.036786530166864395,\n",
       " 0.05655912309885025,\n",
       " 0.023604189977049828,\n",
       " 0.007623808924108744,\n",
       " 0.0415494441986084,\n",
       " -0.00411956524476409,\n",
       " -0.017922308295965195,\n",
       " 0.0042412495240569115,\n",
       " -0.01580672338604927,\n",
       " -0.03281465172767639,\n",
       " -0.014230337925255299,\n",
       " 0.0068601807579398155,\n",
       " -0.027657637372612953,\n",
       " -0.06417032331228256,\n",
       " 0.07062602043151855,\n",
       " -0.0616413839161396,\n",
       " -0.0019539659842848778,\n",
       " -0.059766706079244614,\n",
       " -0.08059738576412201,\n",
       " -0.03646905720233917,\n",
       " 0.007799325976520777,\n",
       " -0.002455034526064992,\n",
       " -0.06246650964021683,\n",
       " -0.01375574804842472,\n",
       " 0.0673004537820816,\n",
       " 0.09693890810012817,\n",
       " -0.03084992803633213,\n",
       " -0.04813076928257942,\n",
       " -0.0149138318374753,\n",
       " -0.012316891923546791,\n",
       " -0.03284360468387604,\n",
       " -0.03704226389527321,\n",
       " 0.07761785387992859,\n",
       " 0.03176496922969818,\n",
       " -0.04391975700855255,\n",
       " -0.03548012301325798,\n",
       " -0.021885711699724197,\n",
       " 0.007007134612649679,\n",
       " -0.04635818675160408,\n",
       " 0.04920407012104988,\n",
       " -0.036316875368356705,\n",
       " -0.05429309606552124,\n",
       " 0.015236897394061089,\n",
       " 0.0204281248152256,\n",
       " -0.050163667649030685,\n",
       " -0.03937951847910881,\n",
       " 0.05852401256561279,\n",
       " 0.04210245609283447,\n",
       " -0.01602414809167385,\n",
       " 0.013313175179064274,\n",
       " -0.05014176294207573,\n",
       " -0.05509320646524429,\n",
       " 0.03183457627892494,\n",
       " 0.00012474741379264742,\n",
       " -0.040051817893981934,\n",
       " -0.07773593813180923,\n",
       " 0.014565061777830124,\n",
       " -0.019984060898423195,\n",
       " 0.05152004212141037,\n",
       " -0.053737569600343704,\n",
       " -0.03719565272331238,\n",
       " -0.02022237330675125,\n",
       " -0.03463384509086609,\n",
       " -0.014638157561421394,\n",
       " -0.01758217252790928,\n",
       " 0.0121022779494524,\n",
       " -0.006651390343904495,\n",
       " -0.02132623828947544,\n",
       " -0.004708611406385899,\n",
       " 0.0808677077293396,\n",
       " 0.007169845048338175,\n",
       " -0.00955832190811634,\n",
       " -0.022584209218621254,\n",
       " -0.06777459383010864,\n",
       " -0.010225220583379269,\n",
       " 0.021945687010884285,\n",
       " -0.022229714319109917,\n",
       " 0.07928422093391418,\n",
       " -0.00916962418705225,\n",
       " -0.08614785224199295,\n",
       " -0.009274925105273724,\n",
       " 0.011190807446837425,\n",
       " -0.004385154694318771,\n",
       " -0.0007071321597322822,\n",
       " -0.05509413778781891,\n",
       " -0.028821254149079323,\n",
       " 0.009087850339710712,\n",
       " 0.03127403184771538,\n",
       " 0.040545567870140076,\n",
       " -0.05360371246933937,\n",
       " -0.043698471039533615,\n",
       " -0.02087540179491043,\n",
       " -0.2959478497505188,\n",
       " -0.056854017078876495,\n",
       " 0.009472960606217384,\n",
       " 0.0720626637339592,\n",
       " 0.07079962641000748,\n",
       " -0.030774744227528572,\n",
       " -0.02670067548751831,\n",
       " 0.040496110916137695,\n",
       " -0.01847195066511631,\n",
       " 0.058620914816856384,\n",
       " 0.03822029009461403,\n",
       " -0.06726327538490295,\n",
       " -0.01563260518014431,\n",
       " 0.02266322448849678,\n",
       " -0.033608052879571915,\n",
       " 0.029646461829543114,\n",
       " 0.042468272149562836,\n",
       " -0.014986851252615452,\n",
       " 0.010273492895066738,\n",
       " 0.039873961359262466,\n",
       " 0.04210256040096283,\n",
       " -0.020526057109236717,\n",
       " -0.024964744225144386,\n",
       " -0.03802621737122536,\n",
       " 0.0023926468566060066,\n",
       " 0.01775098778307438,\n",
       " 0.1484404355287552,\n",
       " 0.08366615325212479,\n",
       " 0.020846648141741753,\n",
       " -0.03616848587989807,\n",
       " 0.10239353775978088,\n",
       " -0.004136086441576481,\n",
       " -0.017505604773759842,\n",
       " -0.10760248452425003,\n",
       " -0.0025731322821229696,\n",
       " 0.014497846364974976,\n",
       " -0.03954414278268814,\n",
       " 0.032209206372499466,\n",
       " -0.01068184245377779,\n",
       " 0.02164340764284134,\n",
       " 0.021686671301722527,\n",
       " -0.006974854506552219,\n",
       " -0.05129995569586754,\n",
       " -0.00444592023268342,\n",
       " 0.021390963345766068,\n",
       " -0.05939382687211037,\n",
       " 0.030589675530791283,\n",
       " -0.025934671983122826,\n",
       " -0.03196267783641815,\n",
       " 0.04364219680428505,\n",
       " -0.009745531715452671,\n",
       " 0.0006951190298423171,\n",
       " 0.05878764018416405,\n",
       " -0.060799308121204376,\n",
       " 0.02098439447581768,\n",
       " -0.0121843870729208,\n",
       " -0.024023838341236115,\n",
       " -0.023334184661507607,\n",
       " 0.0010524616809561849,\n",
       " -0.006437705364078283,\n",
       " 0.011970710940659046,\n",
       " 0.03632187843322754,\n",
       " 0.00544349942356348,\n",
       " -0.02909795753657818,\n",
       " -0.02192872017621994,\n",
       " -0.01368663739413023,\n",
       " -0.04432247579097748,\n",
       " 0.041633591055870056,\n",
       " -0.0008365891990251839,\n",
       " -0.02660989575088024,\n",
       " -0.05157427117228508,\n",
       " 0.05360331013798714,\n",
       " -0.017054378986358643,\n",
       " 0.07762300223112106,\n",
       " 0.023167656734585762,\n",
       " 0.02437606267631054,\n",
       " 0.020622657611966133,\n",
       " -0.0003187966940458864,\n",
       " -0.03123650513589382,\n",
       " -0.03554178774356842,\n",
       " 0.08265889436006546,\n",
       " 0.029620427638292313,\n",
       " 0.05370239168405533,\n",
       " -0.04879758134484291,\n",
       " 0.012056872248649597,\n",
       " 0.037106048315763474,\n",
       " 0.0034972429275512695,\n",
       " -0.03312155231833458,\n",
       " 0.07600225508213043,\n",
       " 0.008966418914496899,\n",
       " 0.0014572828076779842,\n",
       " -0.05434158444404602,\n",
       " -0.04536496475338936,\n",
       " -0.07775513827800751,\n",
       " 0.01579301804304123,\n",
       " 0.021862085908651352,\n",
       " -0.24031473696231842,\n",
       " 0.03148188441991806,\n",
       " 0.012504602782428265,\n",
       " 0.040146347135305405,\n",
       " 0.004566582385450602,\n",
       " 0.051471222192049026,\n",
       " 0.04653371870517731,\n",
       " -0.07843311876058578,\n",
       " -0.065708227455616,\n",
       " 0.04876311868429184,\n",
       " 0.03122846782207489,\n",
       " 0.09291403740644455,\n",
       " -0.05414513126015663,\n",
       " -0.020213717594742775,\n",
       " 0.0020036380738019943,\n",
       " 0.018718328326940536,\n",
       " 0.11710066348314285,\n",
       " 0.004807530902326107,\n",
       " 0.036882150918245316,\n",
       " -0.014148371294140816,\n",
       " 0.02515125460922718,\n",
       " -0.021748678758740425,\n",
       " 0.16071677207946777,\n",
       " -0.055002253502607346,\n",
       " 0.05141568183898926,\n",
       " -0.03282034769654274,\n",
       " -0.01493582222610712,\n",
       " -0.0067159514874219894,\n",
       " -0.015292040072381496,\n",
       " -0.02388644590973854,\n",
       " -0.0025331019423902035,\n",
       " -0.02541000209748745,\n",
       " 0.07730752229690552,\n",
       " -0.030162515118718147,\n",
       " -0.002312432276085019,\n",
       " 0.03554335609078407,\n",
       " 0.005067464895546436,\n",
       " 0.0037934058345854282,\n",
       " 0.04111330211162567,\n",
       " -0.059179194271564484,\n",
       " -0.04080227389931679,\n",
       " 0.03155861049890518,\n",
       " -0.016894003376364708,\n",
       " 0.0034455186687409878,\n",
       " 0.06579404324293137,\n",
       " -0.022694019600749016,\n",
       " 0.06267786771059036,\n",
       " -0.07887183129787445,\n",
       " 0.0011971778003498912,\n",
       " -0.0008776088361628354,\n",
       " 0.005454033147543669,\n",
       " 0.008865955285727978,\n",
       " -0.011412086896598339,\n",
       " 0.0041472879238426685,\n",
       " 0.08145137876272202,\n",
       " 0.013563673011958599,\n",
       " 0.017173124477267265,\n",
       " 0.02305648662149906,\n",
       " 0.015249821357429028,\n",
       " -0.0054061878472566605,\n",
       " -0.049919284880161285,\n",
       " 0.006235422566533089,\n",
       " 0.14151611924171448,\n",
       " 0.06008857488632202,\n",
       " 0.010482442565262318]"
      ]
     },
     "execution_count": 64,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "query_embedding"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 71,
   "metadata": {},
   "outputs": [],
   "source": [
    "# construct vector store query\n",
    "from llama_index.core.vector_stores import VectorStoreQuery\n",
    "\n",
    "query_mode = \"default\"\n",
    "# query_mode = \"sparse\"\n",
    "#uery_mode = \"hybrid\"\n",
    "\n",
    "vector_store_query = VectorStoreQuery(\n",
    "    query_embedding=query_embedding, similarity_top_k=10, mode=query_mode\n",
    ")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 72,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "VectorStoreQuery(query_embedding=[-0.0655275285243988, 0.00894299615174532, -0.02082711085677147, -0.011000980623066425, -0.003246152773499489, -0.05166742578148842, -0.01613280549645424, 0.0027699004858732224, 0.027013229206204414, -0.014961343258619308, -0.01613481156527996, 0.020242992788553238, 0.055608779191970825, -0.038164157420396805, 0.02757468819618225, 0.006564107723534107, 0.009144391864538193, 0.10287594795227051, -0.014657911844551563, 0.03872257098555565, 0.0039942641742527485, 0.01933012530207634, 0.015650464221835136, -0.005154171027243137, -0.035742755979299545, 0.054819319397211075, 0.008804966695606709, -0.021953899413347244, -0.04366825893521309, -0.16800935566425323, 0.03506435826420784, 0.01266274694353342, 0.020349537953734398, 0.0025566352996975183, 0.05346674472093582, 0.061503782868385315, 0.019158581271767616, 0.04917735606431961, 0.01930895447731018, 0.02721797302365303, 0.06182744726538658, -0.027977142482995987, -0.015282899141311646, -0.00042416309588588774, -0.03840223327279091, -0.03003796562552452, 0.009033316746354103, -0.059672486037015915, 0.01615818403661251, -0.008101405575871468, -0.06909218430519104, -0.00965550635010004, 0.02554607391357422, -0.05898534879088402, 0.004323618020862341, 0.014257919043302536, 0.06443752348423004, 0.0350378192961216, 0.017051884904503822, -0.026069246232509613, 0.016631385311484337, 0.0144299091771245, -0.15364211797714233, 0.07357894629240036, 0.08045871555805206, 0.00760251097381115, -0.002353576710447669, -0.007385910488665104, -0.037207040935754776, 0.05340838059782982, -0.07400110363960266, -0.040946003049612045, -0.05775180831551552, 0.057354528456926346, -0.01713745854794979, 0.030918551608920097, -0.024956073611974716, -0.016966557130217552, 0.01235369686037302, -0.04560466855764389, -0.06534416973590851, -0.0042361728847026825, -0.043058525770902634, 0.01295747421681881, -0.0379364974796772, -0.07234914600849152, -0.0009161046473309398, 0.050361502915620804, 0.032396718859672546, -0.033992551267147064, -0.03519567474722862, -0.04125552624464035, 0.0678892433643341, 0.019672976806759834, -0.06367665529251099, -0.023642629384994507, 0.05547138303518295, 0.030260713770985603, 0.007953743450343609, 0.36127975583076477, 0.002777890767902136, 0.012560451403260231, 0.018821587786078453, -0.09674327075481415, 0.04370483011007309, 0.015499209053814411, 0.05655870959162712, 0.04968508332967758, 0.0019995879847556353, -0.01647675409913063, 0.04283532872796059, -0.04516208544373512, 0.06576249748468399, -0.05357412248849869, 0.009202097542583942, -0.00775961484760046, 0.007239254657179117, 0.033008284866809845, -0.020264729857444763, -0.0059938919730484486, -0.043872784823179245, -0.01198253408074379, 0.047894593328237534, 0.005976979620754719, 0.09433038532733917, -0.03484949469566345, 0.008069703355431557, 0.1016203835606575, -0.0096282372251153, 0.022880414500832558, 0.01847226545214653, -0.036786530166864395, 0.05655912309885025, 0.023604189977049828, 0.007623808924108744, 0.0415494441986084, -0.00411956524476409, -0.017922308295965195, 0.0042412495240569115, -0.01580672338604927, -0.03281465172767639, -0.014230337925255299, 0.0068601807579398155, -0.027657637372612953, -0.06417032331228256, 0.07062602043151855, -0.0616413839161396, -0.0019539659842848778, -0.059766706079244614, -0.08059738576412201, -0.03646905720233917, 0.007799325976520777, -0.002455034526064992, -0.06246650964021683, -0.01375574804842472, 0.0673004537820816, 0.09693890810012817, -0.03084992803633213, -0.04813076928257942, -0.0149138318374753, -0.012316891923546791, -0.03284360468387604, -0.03704226389527321, 0.07761785387992859, 0.03176496922969818, -0.04391975700855255, -0.03548012301325798, -0.021885711699724197, 0.007007134612649679, -0.04635818675160408, 0.04920407012104988, -0.036316875368356705, -0.05429309606552124, 0.015236897394061089, 0.0204281248152256, -0.050163667649030685, -0.03937951847910881, 0.05852401256561279, 0.04210245609283447, -0.01602414809167385, 0.013313175179064274, -0.05014176294207573, -0.05509320646524429, 0.03183457627892494, 0.00012474741379264742, -0.040051817893981934, -0.07773593813180923, 0.014565061777830124, -0.019984060898423195, 0.05152004212141037, -0.053737569600343704, -0.03719565272331238, -0.02022237330675125, -0.03463384509086609, -0.014638157561421394, -0.01758217252790928, 0.0121022779494524, -0.006651390343904495, -0.02132623828947544, -0.004708611406385899, 0.0808677077293396, 0.007169845048338175, -0.00955832190811634, -0.022584209218621254, -0.06777459383010864, -0.010225220583379269, 0.021945687010884285, -0.022229714319109917, 0.07928422093391418, -0.00916962418705225, -0.08614785224199295, -0.009274925105273724, 0.011190807446837425, -0.004385154694318771, -0.0007071321597322822, -0.05509413778781891, -0.028821254149079323, 0.009087850339710712, 0.03127403184771538, 0.040545567870140076, -0.05360371246933937, -0.043698471039533615, -0.02087540179491043, -0.2959478497505188, -0.056854017078876495, 0.009472960606217384, 0.0720626637339592, 0.07079962641000748, -0.030774744227528572, -0.02670067548751831, 0.040496110916137695, -0.01847195066511631, 0.058620914816856384, 0.03822029009461403, -0.06726327538490295, -0.01563260518014431, 0.02266322448849678, -0.033608052879571915, 0.029646461829543114, 0.042468272149562836, -0.014986851252615452, 0.010273492895066738, 0.039873961359262466, 0.04210256040096283, -0.020526057109236717, -0.024964744225144386, -0.03802621737122536, 0.0023926468566060066, 0.01775098778307438, 0.1484404355287552, 0.08366615325212479, 0.020846648141741753, -0.03616848587989807, 0.10239353775978088, -0.004136086441576481, -0.017505604773759842, -0.10760248452425003, -0.0025731322821229696, 0.014497846364974976, -0.03954414278268814, 0.032209206372499466, -0.01068184245377779, 0.02164340764284134, 0.021686671301722527, -0.006974854506552219, -0.05129995569586754, -0.00444592023268342, 0.021390963345766068, -0.05939382687211037, 0.030589675530791283, -0.025934671983122826, -0.03196267783641815, 0.04364219680428505, -0.009745531715452671, 0.0006951190298423171, 0.05878764018416405, -0.060799308121204376, 0.02098439447581768, -0.0121843870729208, -0.024023838341236115, -0.023334184661507607, 0.0010524616809561849, -0.006437705364078283, 0.011970710940659046, 0.03632187843322754, 0.00544349942356348, -0.02909795753657818, -0.02192872017621994, -0.01368663739413023, -0.04432247579097748, 0.041633591055870056, -0.0008365891990251839, -0.02660989575088024, -0.05157427117228508, 0.05360331013798714, -0.017054378986358643, 0.07762300223112106, 0.023167656734585762, 0.02437606267631054, 0.020622657611966133, -0.0003187966940458864, -0.03123650513589382, -0.03554178774356842, 0.08265889436006546, 0.029620427638292313, 0.05370239168405533, -0.04879758134484291, 0.012056872248649597, 0.037106048315763474, 0.0034972429275512695, -0.03312155231833458, 0.07600225508213043, 0.008966418914496899, 0.0014572828076779842, -0.05434158444404602, -0.04536496475338936, -0.07775513827800751, 0.01579301804304123, 0.021862085908651352, -0.24031473696231842, 0.03148188441991806, 0.012504602782428265, 0.040146347135305405, 0.004566582385450602, 0.051471222192049026, 0.04653371870517731, -0.07843311876058578, -0.065708227455616, 0.04876311868429184, 0.03122846782207489, 0.09291403740644455, -0.05414513126015663, -0.020213717594742775, 0.0020036380738019943, 0.018718328326940536, 0.11710066348314285, 0.004807530902326107, 0.036882150918245316, -0.014148371294140816, 0.02515125460922718, -0.021748678758740425, 0.16071677207946777, -0.055002253502607346, 0.05141568183898926, -0.03282034769654274, -0.01493582222610712, -0.0067159514874219894, -0.015292040072381496, -0.02388644590973854, -0.0025331019423902035, -0.02541000209748745, 0.07730752229690552, -0.030162515118718147, -0.002312432276085019, 0.03554335609078407, 0.005067464895546436, 0.0037934058345854282, 0.04111330211162567, -0.059179194271564484, -0.04080227389931679, 0.03155861049890518, -0.016894003376364708, 0.0034455186687409878, 0.06579404324293137, -0.022694019600749016, 0.06267786771059036, -0.07887183129787445, 0.0011971778003498912, -0.0008776088361628354, 0.005454033147543669, 0.008865955285727978, -0.011412086896598339, 0.0041472879238426685, 0.08145137876272202, 0.013563673011958599, 0.017173124477267265, 0.02305648662149906, 0.015249821357429028, -0.0054061878472566605, -0.049919284880161285, 0.006235422566533089, 0.14151611924171448, 0.06008857488632202, 0.010482442565262318], similarity_top_k=10, doc_ids=None, node_ids=None, query_str=None, output_fields=None, embedding_field=None, mode='default', alpha=None, filters=None, mmr_threshold=None, sparse_top_k=None, hybrid_top_k=None)"
      ]
     },
     "execution_count": 72,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "vector_store_query"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 73,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "VectorStoreQueryResult(nodes=[], similarities=[], ids=[])\n"
     ]
    }
   ],
   "source": [
    "# returns a VectorStoreQueryResult\n",
    "query_result = vector_store.query(vector_store_query)\n",
    "print(query_result)"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "whispertest-WbvfCJ5O",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.12"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}