https://duandahai.com/Recent content on DUAN DAHAIHugo -- gohugo.ioenSat, 30 Dec 2023 00:00:00 +0000https://duandahai.com/posts/en/20231220-use-cicd-for-aws-lamda-stepfunctions/Sat, 30 Dec 2023 00:00:00 +0000https://duandahai.com/posts/en/20231220-use-cicd-for-aws-lamda-stepfunctions/In this case, I will share some points about use AWS SAM to deploy serverless applications on AWS. If you want to know the details or the base knowledge about CI/CD/SAM, you can ask ChatGPT or Google to get more professional answers. When you want to start with this blog, you need to prepared for this: IAM role codecommit repository code build pipeline with only source and build is ok. project structure Link to heading Create your project straucture like this.https://duandahai.com/posts/en/20230301-hold-state-input-in-stepfunctions/Wed, 01 Mar 2023 00:00:00 +0000https://duandahai.com/posts/en/20230301-hold-state-input-in-stepfunctions/In this case, I use the Stepfunctions as my API endpoint. There are 2 lambdas need to be run base one the first lambda’s return code in the stepfunctions. All the 3 lambdas need to get the http request body data from statemachine’s state input. So, I considered if anything can save the state input at first, then the other lambda can use it as inputPath, actually, no thus solution after read aws document about stepfunction.https://duandahai.com/posts/en/20230207-use-aws-lambda-as-api-endpoint/Tue, 07 Feb 2023 00:00:00 +0000https://duandahai.com/posts/en/20230207-use-aws-lambda-as-api-endpoint/AWS Lambda + API Gateway can easily and quickly build your api servcie. You can find the the introduce and Benefits on aws documents. I will just show you how eazy to build a api in this article. Create a python lambda by your fastest way Link to heading Create a HTTP API by AWS API Gateway Link to heading when creating the HTTP API, use the default stage and default settings Link to heading add a test rout linked to python lambda as the endpoint Link to heading then test your api in browser, connected backend lambda successfully!https://duandahai.com/posts/en/20221215-call-powershell-in-vba/Thu, 15 Dec 2022 00:00:00 +0000https://duandahai.com/posts/en/20221215-call-powershell-in-vba/In an auto task VBA tool, I find that instead of VBA scripts, call a powershell file can use some more effective solutions. So I share an example that call a Powershell file in VBA. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 Dim command As String Dim wsh As Object Dim result As Long command = "powershell -NoProfile -ExecutionPolicy Unrestricted " command = command & "C:¥yourPowershellFile.https://duandahai.com/posts/en/20221205-use-custom-domain-on-aws-ses/Mon, 05 Dec 2022 00:00:00 +0000https://duandahai.com/posts/en/20221205-use-custom-domain-on-aws-ses/In most applications, you may need SMTP service for send some system notifications, you need not hosting your own SMTP server, because it is much more difficult to do reliably than to use a third-party provider. In this article, I will show how I use the AWS SES on my own domain. Get a domain Link to heading You can get one from onamae, also you can get one from godaddy.https://duandahai.com/posts/en/20221028-setup-spark-in-windows/Fri, 28 Oct 2022 00:00:00 +0000https://duandahai.com/posts/en/20221028-setup-spark-in-windows/When you want to start learning about spark and try to write or run some scripts, you needn’t spent time to search the integration solution about spark environment, you needn’t confuse that you don’t have a linux environment or a cloud service account. Just take the integrated spark environment into your own PC, only one step setup, then you can use it. and even you needn’t to install anything in your PC.https://duandahai.com/posts/en/20220616-send-html-via-email/Thu, 16 Jun 2022 00:00:00 +0000https://duandahai.com/posts/en/20220616-send-html-via-email/Use API for send html form via email. Link to heading For an online html site, in some case ,it has no hosted server or just want to get the information submitted in the form via email without backend program. This post introduce one API that can help you make it simple and easily. You can just set your form action like this: 1 2 3 <form action="https://formsendbox.com/sendto/[set your receive email at here]" method="post"> some input contents </from> When one submit this form, the API will send the input form to your email.https://duandahai.com/posts/en/20220329-win-scpto-linux/Tue, 29 Mar 2022 00:00:00 +0000https://duandahai.com/posts/en/20220329-win-scpto-linux/When we want to scp files from Windows to linux in our application, and there is a limit to install a software, we can use the WinSCP Command-line in Windows command prompt. WinSCP Command-line have two modes (Console/scripting mode), I listed the console mode basic sample below. 1 C:¥winscp¥winscp.com /command "option batch on" "option confirm off" "open sftp://[scp user]:[scp password]@[scp to ipaddress]" "put C:¥test¥test01.txt" "/temp/" "option transfer binary" "close" "exit" Reference Link to heading We can also use any other options in WinSCP Command-line Options.https://duandahai.com/posts/en/20220105-sbl-agile-team/Wed, 05 Jan 2022 00:00:00 +0000https://duandahai.com/posts/en/20220105-sbl-agile-team/Share my SBL in agile develop team. The task items sheet is look like this: The burndown sheet is look like this: You can click here(En) here(JP) to download the SBL Excle.https://duandahai.com/posts/en/20211208-algorithm-quicksort/Wed, 08 Dec 2021 00:00:00 +0000https://duandahai.com/posts/en/20211208-algorithm-quicksort/In a quick sort algorithm, It picks an element as a pivot and partitions the given array around the picked pivot. (For sort by ascending, it moves smaller number to the pivot’s left, and moves bigger number to the pivot’s right) I wrote two classic samples by use python. Always pick the first element as a pivot. Always pick the last element as a pivot. This is a sample for quick sort that start from first value as pivot Link to heading 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 # change the position on each number def swapEachOther(arr, leftIndex, rightIndex): tmp = arr[leftIndex] arr[leftIndex] = arr[rightIndex] arr[rightIndex] = tmp print(arr) # quck sort method : start from first number by pivot def sort(arr, startIndex, endIndex): if startIndex >= endIndex: return leftIndex = startIndex rightIndex = endIndex # set the first pivot by first number compareValue = arr[startIndex] while leftIndex < rightIndex: # find the next pivot that was smaller than compareValue from right while leftIndex < rightIndex and arr[rightIndex] > compareValue: rightIndex = rightIndex - 1 # find the next pivot that was bigger than compareValue from left while leftIndex < rightIndex and arr[leftIndex] <= compareValue: leftIndex = leftIndex + 1 # while finding the next pivot, move smaller number to left and move bigger number to right if leftIndex < rightIndex: swapEachOther(arr, leftIndex, rightIndex) # move the pivot to the middle posotion swapEachOther(arr, startIndex, rightIndex) # use the sort method on left half array sort(arr, startIndex, rightIndex - 1) # use the sort method on right half array sort(arr, rightIndex + 1, endIndex) arr = [3, 1, 2, 9, 4, 10, 5, 8, 6, 7] print(arr) sort(arr, 0, len(arr) -1) This is a sample for quick sort that start from last number as pivot Link to heading 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 # change the position on each number def swapEachOther(arr, leftIndex, rightIndex): tmp = arr[leftIndex] arr[leftIndex] = arr[rightIndex] arr[rightIndex] = tmp print(arr) # quck sort method : def sort(arr, startIndex, endIndex): if startIndex >= endIndex: return # set the last number as the pivot number pivotIndex = endIndex # set the partitionIndex before the startIndex partitionIndex = startIndex -1 # change the positon when it smaller than pivot number from left for i in range(startIndex, endIndex): if arr[i] <= arr[pivotIndex]: # move the smaller number to the left of bigger number than pivot partitionIndex = partitionIndex + 1 swapEachOther(arr, partitionIndex, i) # get the partitionIndex that will be cut the array in half partitionIndex = partitionIndex + 1 # move the pivot to the middle posotion swapEachOther(arr, partitionIndex, pivotIndex) # use the sort method on left half array sort(arr, startIndex, partitionIndex - 1) # use the sort method on right half array sort(arr, partitionIndex + 1, endIndex) arr = [3, 1, 2, 9, 4, 10, 5, 8, 6, 7] print(arr) sort(arr, 0, len(arr) -1) You can click here(QuickSort1) , here(QuickSort2) to download the source file.https://duandahai.com/about/Mon, 25 Oct 2021 00:00:00 +0000https://duandahai.com/about/This is Dan’s multilingual blog, recording project issues or solutions, also sharing some stories about myself. I hope you will like it. The blogs of recommendation: Simply setup spark in windows OS Database monitoring system StepFunctionsにLambda動的並列実行 基于云服务的Mastodon站点搭建 If you are interesting in my projects or want to know more details, move to my GitHub.https://duandahai.com/posts/en/20210607-real-time-monitoring-db/Mon, 07 Jun 2021 00:00:00 +0000https://duandahai.com/posts/en/20210607-real-time-monitoring-db/ The design of monitoring system Link to heading In some case we need monitor application’s latest data in database on time. We could built a monitoring system out of the application. In this case, to handle a large of new data per second with high-performance, we can build the monitoring system like this: Output new inserted data into monitoring system database by trigger Output new inserted data into Queque(like AWS SQS) by trigger Get new data from Queque and execute your monitoring app in dynamic multiple processhttps://duandahai.com/contact/Mon, 01 Jan 0001 00:00:00 +0000https://duandahai.com/contact/I’m a software engineer also a small company director living in Japan with my family. I like reading, music, cycle and nature. If you are interesting about my bolgs or projects, please contact me.https://duandahai.com/projects/Mon, 01 Jan 0001 00:00:00 +0000https://duandahai.com/projects/win-spark-env Link to heading Simple spark environment setup in windows OS. DBMerge Link to heading Diff tables in Oracle database with high speed. formsendbox Link to heading Send mail web service. timecard-online Link to heading Create and send timecard pdf by online. D-Tools Link to heading Useful and efficiently VBA Tools in develop work.