How to – Configure Cloudconnector via CLI on Unity

Hello and welcome to a new another video in the how to series. This one today is concentrating on how to configure the cloud connector. Via the command line.

My name is Richard Hornsby and the good news is that in a later release all of this will be included in the GUI so it should be a little bit more simple. But this is just a good example if you did want to configure this via the command line.

So, what is Cloudconnector trying to do for us? Well it's trying to either Sync, Copy, or Move data from the Unity storage array up into the cloud. Ok so there's a few examples AWS, Azure, Google Cloud, Wasabi for example, or any public cloud - but that's all it's trying to do, ok? Just transfer files from a local file system out to cloud.

So here I am in AWS, the first thing i am going to do is create a S3 bucket. I've been here before, but you can never get your way through this and find yourself.

Ok we're just going to go ahead here and create a bucket. Now then region wise, I'm here but you may be in your own particular region. That will be important later, so make sure you've got it set for the right place. I am not going to show you how to do all of this, you guys will no doubt know AWS better than me.

So here I am just going to put an example in. I am going to call it "howtovideo". That will be the name of the bucket.

Ownership, etcetera, i am just going to go through all of this. I'm going to keep versioning disabled just for easy use for the demo. Under advanced settings you'll have things object locks, so I'm going to keep that disabled as well to me now, I can tidy up after myself.

Once you have that, I am just going to click on "Make Bucket" the bucket and there's nothing in it at the moment. So it's created the bucket, and there's nothing in it at the moment.

We can just check that out. It should now list a bucket underneath general purpose. Or one more thing that you'll need to do. Under the, the IAM, or identity and access management, console, you will need to create an access key. All you need to do there is create access key.
What it will do is create an access key and a secret access key that it will only display once - so make sure you make a note of it. You will need those to add to the Cloudconnector command to get everything working.

So I, I'm just going to go ahead and click on Done. I've just created some dummy files, in the OK file, one, two, three, and four. So that's that's kind of our test situation, these are the files I want to transfer into cloud. And the way to do that is to do that is to do it in the interface for that particular unity. Now, typically with any kind of commandient in, so you don't put any typos in, just click on the file. So we can call all this again. We'll just call it how to. For the. And then what we did to do is tell it who's going to be the provider. So we're going to look at AWS this time. But again, you could put in Azure files or whatever. OK, but then it's looking for those access key. So a minus a and then the access key that you have. So I'm just going to go ahead and copy those in. There's that one. So that's the the access key. The next one is the secret access key. And remember, that's the one that kind of only shows itself once. So make sure you've got a copy of it. The next bit is asking for an endpoint. So that is going to be Amazon. OK, so you have to be quite careful. So I'm going to I'm going to almost I'm obviously copying. . So I'm going to point going to the region that I'm in. OK, so that's the end point Amazon AWS. OK, so I'm going to be kind of more specific. OK, so. OK, so let's just do cloud connector. Config show will show you you'll see some other entries in there. But you can you can see the one that I've added the how to video bit. If you do need a little bit more information, you can do things like cloud connector. Config show keys. OK, OK. And that will show you things that were missing like the access key and the secret access key. And that will show you things that were missing like And that will show you things that were missing like So the first thing I'm going to do's is the sink. So let's see how that behaves. And then we're going to attempt to do a copy and a move as well. OK, so again, if we forget, you knowcor we're doing in terms. Is easily done. and we can just do cloud connector. And just the if I just move this it is just the name of the file system that we want to transfer. OK, so it's going to be make a case sensitive. OK, so we're going to do a copy. So we're going to do a copy. And then we will do a copy. And then we'll do a copy. call give it kind of the destination. The destination is the name of the the bucket we created, which was how to do. So what that will do is any files that currently exist in the cloud connector file share synchronize that up into the cloud. I hope so let's just click on enter. So we'll think about it and hopefully it'll say it's done. Now there is a nice way to see exactly it has done. So again you can click on and cloud connector. And we can do jobs here to turn. You'll see you'll see a few and soon. You can see the latest one at the very top. So then you can see what that has done. So again just recall that last command and then we'll go log and it's the number on the left hand side here. There's a particular log you want to look at. It's this number on the left hand side here. There's a particular log you want to look at. It's this number not this is going to go for number one. Number one and here we turn. Let's see if it works. We can tell over to our bucket click on it. And let's see hopefully we should have five files. Now we haven't but what we can do here is we can sometimes refresh the entire thing and that will work. I said that confidently in my. So how to do your next exam and there you go. Now that is a. That is a trick. Now, that is a trick. Now, that is a trick. Okay, so I've been caught out with that before where it doesn't show the files and you think it hasn't worked work. So you know I've even like clicked off and then back on again they don't show a full refresh will bring the files in place. Okay, so there you go. So we've copied all of those files that existed on the unity into cloud. And that will serve as your kind of extra copy, DR, whatever you want to call it. So now it's probably good idea to kind of test that I guess. So if we we had to to our file, what we can do here is we can let's I mean, let's try so let's add. So let's do let's do. Text document. We'll just call this new file. Okay, I won't put too much in it. I'll just put some stuff. It's about badly doesn't matter. I'll just save that back. New file. Okay, so that's there. So let's recall the command. And let's do another sync. Okay, just let, let's do a little bit of Moss back. To do, let's go back. And let's do this. If I have to go back to the earliest. So a bit interesting. I'm sorry. So let's do this. Is this something that I'm upset? go back to here. Let's refresh the page. And file one should be missing. And that's why it's different back to Unity. Let's do recall the command. Let's change that word sync. Let's change that copy and hit some of the process. Think about it, give you the usual message Let's go back to the file share, and let's do something crazy like remove, let's remove the new file Now if we do a copy again, let's remove the new file It should just copy what is here into the cloud. It shouldn't remove that new file that we should be there. And it is. Yeah, so the difference if I did a sync there, it would have removed it. Save that back. Let's recall the command and we'll change copy to move. Now I'm expecting it to remove this. There you go. Completely gone. But what we should see is move here. Again, let's refresh the screen. Once it's refreshed we should see the word move. So three different methods for you to try. Depending on what the the use case is and what you need it to do for you, it could be that you're just trying to maybe get some data storage user will storage back on the next one which is fine. And there's all of your copies. Now that's great. But now what you can do is you can schedule them. Okay, so the command for that is cloud, Chrome. So again's again, if you're unsure of how to make these commands you can just you know, recall it. Now, what you do is cloud, Chrome. Okay, and you still add in the same kind of jobs. Next, I should have made that short. So that's the job that you're going to that's the job that you're going to ask it to do. Okay, you can give it a name, let's call that test might help to identify, and then the frequency. Okay, so we want minus of case, e, I'm going to do this every day. So I'm going to do it every day. If you put three D in there, do it every three days examples on the screen. And then let's set a minute. So let's do zero zero and then hour. So we want to do this. I don't know, one in the morning. So, something like that, yeah, and then it's just hit. And there you can see the entry being entered into the Chrome. If you want to look at that, you caned can obviously just do cloud. So if you think, oh, I don't want to do that. I want to change that. You just do cloud, Chrome, remove, remove. And then this is the trick you just need to add this bin here. So you copy the actual command that you used. Not doing that very well. Copy that. Right click. Oh, there you go. I think you did it. So it goes, oh, I think I'm serious. Yeah, I did. Let's try that again. Let's go cloud. Chrome. Paste that in. And then you'll say it's removing it. So again, you can check the point that it has actually removed it just by doing cloud crunch show. And there you go. Completely blank. So that's it for this episode. Hopefully you found that useful. And it's complicated. So it's just good to have the reference there. You can rewind forward on the video if you need to. But thank you very much for joining me. And hopefully we'll see you on the next one. Thanks.